00000001:02000400:3.0F:1789265204.397298:0:3299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_hostid 00000001:02000400:3.0:1789265226.117531:0:3520:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789265228.437302:0:3577:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 907 MB/s 00000001:01000000:3.0:1789265228.689197:0:3577:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1273 MB/s 00000001:01000000:2.0:1789265228.939005:0:3577:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8839 MB/s 00000020:02000000:2.0:1789265229.924131:0:3612:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_106_gd81f50d 00000400:02000000:0.0F:1789265231.253358:0:3627:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.142@tcp [8/256/0/180] 00008000:02000000:1.0F:1789265235.348717:0:3776:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789265298.614658:0:5744:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789265314.181022:0:6495:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789265314.181028:0:6495:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789265314.181030:0:6495:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789265314.181184:0:6495:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000019c0391e 00000080:02000400:3.0:1789265314.181197:0:6495:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789265314.200730:0:6495:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789265314.200749:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789265314.200794:0:6495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000008822fea) 00000020:00000080:3.0:1789265314.200815:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789265314.286468:0:6495:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789265314.286555:0:6495:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1789265314.326853:0:6495:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789265314.327370:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789265314.327378:0:6495:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789265314.327391:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d34f1 00000020:01000004:1.0:1789265314.327398:0:6495:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789265314.327404:0:6495:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789265314.327409:0:6495:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000019c0391e from MGS 00000020:01000004:1.0:1789265314.327414:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789265314.327433:0:6495:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a623994a) 00000020:00000080:1.0:1789265314.327443:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789265314.327545:0:6495:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000019c0391e from MGS, refs=2 00080000:01000000:1.0:1789265314.327552:0:6495:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789265314.327558:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d34ff 00000100:00100000:1.0:1789265314.327654:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789265314.331842:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789265314.331854:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789265314.333374:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789265314.333384:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789265314.334319:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265314.334509:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789265314.334516:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789265314.338846:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789265314.338888:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789265314.344752:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789265314.344766:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789265314.347297:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265314.347303:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265314.347305:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265314.348420:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265314.348424:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265314.348426:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265314.349322:0:6495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789265314.352426:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789265314.606242:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2474 MB/s 00000001:01000000:3.0:1789265314.857277:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2591 MB/s 00000001:01000000:0.0:1789265315.109816:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 341 MB/s 00000001:01000000:0.0:1789265315.359090:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 951 MB/s 00080000:10000000:0.0:1789265315.363343:0:6495:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1789265315.370717:0:6495:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789265315.375464:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789265315.375535:0:6495:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789265315.375594:0:6495:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789265315.375833:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789265315.375890:0:6495:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789265315.376236:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265315.376422:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789265315.376429:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789265315.378499:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789265315.378512:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:2.0:1789265315.382446:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265315.382490:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789265315.382501:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789265315.384024:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789265315.384049:0:6495:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.142@tcp' 00000020:01000004:2.0:1789265315.384052:0:6495:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789265315.384145:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.142@tcp (typ=mgc) 00000020:00000080:2.0:1789265315.384166:0:6495:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.142@tcp (00000000a19958a3) 00000020:00000080:2.0:1789265315.384184:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789265315.384320:0:6495:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000070d20cb4@MGC192.168.202.142@tcp: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1789265315.384472:0:6495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.142@tcp-0 is initialized 00000040:01000000:2.0:1789265315.384479:0:6495:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789265315.388290:0:6515:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789265315.388507:0:6516:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789265315.388589:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.142@tcp (uuid 50e161d8-da73-42e3-8b96-d311cd2235de) 00000020:00000080:1.0:1789265315.388610:0:6495:0:(genops.c:1385:class_connect()) connect: client 50e161d8-da73-42e3-8b96-d311cd2235de, cookie 0xbbfdc9019c1d350d 00000100:00080000:1.0:1789265315.388623:0:6495:0:(import.c:510:import_select_connection()) MGC192.168.202.142@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265315.388628:0:6495:0:(import.c:624:import_select_connection()) MGC192.168.202.142@tcp: import 0000000070d20cb4 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1789265315.388678:0:6495:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ab6ca441 x1876180578861184/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265315.388707:0:6495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 50e161d8-da73-42e3-8b96-d311cd2235de->MGS 00000020:01000004:1.0:1789265315.388727:0:6495:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789265315.388732:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789265315.388745:0:6495:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d8c34a86) 00000020:00000080:1.0:1789265315.388757:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789265315.392297:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab6ca441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:50e161d8-da73-42e3-8b96-d311cd2235de:3642:1876180578861184:0@lo:250: 00000100:00100000:2.0:1789265315.392417:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265315.392502:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578861184 00000100:00100000:2.0:1789265315.392521:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578861184 00000100:00100000:2.0:1789265315.392557:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265315.392563:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009a64622 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1876180578861184:12345-0@lo:250: 00010000:00080000:2.0:1789265315.392589:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 50e161d8-da73-42e3-8b96-d311cd2235de@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:2.0:1789265315.392614:0:6512:0:(genops.c:1385:class_connect()) connect: client 50e161d8-da73-42e3-8b96-d311cd2235de, cookie 0xbbfdc9019c1d351b 00000100:00080000:2.0:1789265315.392739:0:6512:0:(import.c:65:import_set_state_nolock()) 0000000097c86e5a : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265315.392789:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009a64622 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+5:3642:x1876180578861184:12345-0@lo:250: Request processed in 225us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.392798:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265315.392836:0:3642:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.142@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789265315.392844:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.142@tcp: connect to target with instance 0 00000100:00080000:2.0:1789265315.392851:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.142@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789265315.392855:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789265315.392884:0:3642:0:(import.c:65:import_set_state_nolock()) 0000000070d20cb4 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789265315.392886:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789265315.392893:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789265315.392897:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab6ca441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:50e161d8-da73-42e3-8b96-d311cd2235de:3642:1876180578861184:0@lo:250: 00000100:00100000:1.0:1789265315.401138:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265315.401405:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789265315.401413:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789265315.404468:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789265315.404483:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789265315.407298:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789265315.407309:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789265315.408274:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265315.408453:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789265315.408466:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789265315.409414:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789265315.409425:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789265315.479819:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265315.480218:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789265315.480224:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789265315.481290:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789265315.481300:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789265315.487276:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265315.487497:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265315.487508:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789265315.488196:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265315.488203:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789265315.488670:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265315.488843:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265315.488848:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789265315.489325:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265315.489331:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789265315.489798:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265315.490098:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265315.490104:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789265315.490569:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265315.490576:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789265315.508823:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265315.509175:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789265315.509182:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789265315.510356:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789265315.510365:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789265315.511108:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789265315.511133:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789265315.513411:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789265315.513441:0:6495:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789265315.513447:0:6495:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789265315.513559:0:6495:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789265315.513592:0:6495:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.142@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789265315.513597:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789265315.513598:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265315.513600:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265315.513601:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265315.513602:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265315.513603:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265315.513604:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265315.513605:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265315.513607:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265315.513608:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265315.513609:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265315.513614:0:6495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265315.513616:0:6495:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789265315.513619:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265315.513620:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265315.513620:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265315.513621:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265315.513622:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265315.513623:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265315.513624:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265315.513625:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265315.513626:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265315.513627:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265315.513627:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265315.513628:0:6495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265315.513666:0:6495:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789265315.513686:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578861312:0@lo:253: 00000100:00100000:3.0:1789265315.513780:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.513901:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 000000005581fa2c going to sleep for 11 seconds 00000100:00100000:1.0:1789265315.514058:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578861312 00000100:00100000:1.0:1789265315.514067:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578861312 00000100:00100000:1.0:1789265315.514161:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265315.514171:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dcc8822 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+5:6495:x1876180578861312:12345-0@lo:253: 20000000:01000000:1.0:1789265315.514219:0:6514:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789265315.514223:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789265315.514499:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789265315.514557:0:6514:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789265315.514826:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265315.515795:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789265315.516065:0:6514:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789265315.516069:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789265315.516074:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789265315.516077:0:6514:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789265315.516086:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789265315.516209:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265315.516334:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789265315.516347:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789265315.516361:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789265315.516383:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789265315.516403:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789265315.516443:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789265315.516449:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789265315.516459:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789265315.516463:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789265315.516473:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789265315.516476:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789265315.516486:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789265315.516497:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789265315.516514:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789265315.516518:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789265315.516524:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265315.516593:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789265315.516601:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789265315.516613:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789265315.516624:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789265315.516635:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789265315.516641:0:6514:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789265315.516662:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789265315.516669:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789265315.516681:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789265315.516693:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789265315.516705:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789265315.516711:0:6514:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789265315.516729:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789265315.516735:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789265315.516756:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789265315.516769:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789265315.516818:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789265315.516834:0:6514:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789265315.516840:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789265315.517340:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789265315.517486:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789265315.517512:0:6514:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.142@tcp for mdt 20000000:01000000:1.0:1789265315.517513:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:1.0:1789265315.517525:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789265315.517530:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789265315.517540:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789265315.517543:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:1.0:1789265315.517553:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789265315.517559:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789265315.517568:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789265315.517580:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789265315.517600:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789265315.517603:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789265315.517606:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789265315.517659:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789265315.517661:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789265315.517940:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789265315.518061:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789265315.518077:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789265315.518088:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789265315.518095:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789265315.518097:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789265315.518313:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1789265315.518428:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789265315.518443:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1789265315.518454:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1789265315.518462:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265315.518464:0:6514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1789265315.518468:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789265315.518470:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789265315.518474:0:6514:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789265315.518479:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789265315.518750:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789265315.518840:0:6514:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789265315.525095:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789265315.525156:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789265315.525200:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789265315.525224:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789265315.525247:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b760e6f6/0xbbfdc9019c1d3522 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.525265:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b760e6f6/0xbbfdc9019c1d3522 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.525277:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b760e6f6/0xbbfdc9019c1d3522 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.525284:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b760e6f6/0xbbfdc9019c1d3522 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.525290:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b760e6f6/0xbbfdc9019c1d3522 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.525296:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b760e6f6/0xbbfdc9019c1d3522 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.525302:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b760e6f6 already unused, calling callback (00000000f2b4c23c) 00010000:00010000:1.0:1789265315.525305:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b760e6f6/0xbbfdc9019c1d3522 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.525312:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b760e6f6/0xbbfdc9019c1d3522 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.525323:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b760e6f6/0xbbfdc9019c1d3522 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.525342:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b760e6f6/0xbbfdc9019c1d3522 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.525347:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b760e6f6/0xbbfdc9019c1d3522 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789265315.525366:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789265315.532246:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dcc8822 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+5:6495:x1876180578861312:12345-0@lo:253: Request processed in 18069us (18458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.532261:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265315.532345:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578861312:0@lo:253: 10000000:01000000:3.0:1789265315.532360:0:6495:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789265315.532363:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265315.532365:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265315.532366:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265315.532367:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789265315.532368:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265315.532370:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265315.532371:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265315.532372:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265315.532373:0:6495:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789265315.532374:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265315.532382:0:6495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789265315.532402:0:6495:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000019c0391e from lustre-MDT0000 10000000:01000000:3.0:1789265315.532432:0:6495:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789265315.532434:0:6495:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789265315.532439:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93775f68cd28 10000000:01000000:3.0:1789265315.532442:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265315.532449:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93775f68cd28 from 1 10000000:01000000:3.0:1789265315.532452:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789265315.532486:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.532496:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.532504:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265315.532520:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578861440:0@lo:101: 00000100:00100000:3.0:1789265315.532554:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.532602:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efce6434 going to sleep for 11 seconds 00000100:00100000:2.0:1789265315.532665:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578861440 00000100:00100000:2.0:1789265315.532673:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578861440 00000100:00100000:2.0:1789265315.532773:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265315.532788:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddc154e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+5:6495:x1876180578861440:12345-0@lo:101: 00010000:00010000:2.0:1789265315.532802:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265315.532814:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fcafb728/0xbbfdc9019c1d3530 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3529 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.532837:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fcafb728/0xbbfdc9019c1d3530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3529 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.532846:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fcafb728/0xbbfdc9019c1d3530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3529 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.532854:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fcafb728, rc 0) 00000100:00100000:2.0:1789265315.532920:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddc154e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+6:6495:x1876180578861440:12345-0@lo:101: Request processed in 134us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.532926:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265315.532996:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578861440:0@lo:101: 00010000:00010000:3.0:1789265315.533008:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3530 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.533016:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3530 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265315.533063:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578861568:0@lo:501: 00000100:00100000:3.0:1789265315.533086:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.533360:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efce6434 going to sleep for 11 seconds 00000100:00100000:0.0:1789265315.533417:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578861568 00000100:00100000:0.0:1789265315.533422:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578861568 00000100:00100000:0.0:1789265315.533457:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265315.533463:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc1747ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+6:6495:x1876180578861568:12345-0@lo:501: 00000100:00100000:0.0:1789265315.533543:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc1747ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+6:6495:x1876180578861568:12345-0@lo:501: Request processed in 80us (456us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265315.533550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265315.533672:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578861568:0@lo:501: 10000000:01000000:3.0:1789265315.533702:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789265315.533716:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3530 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.533725:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3530 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265315.533733:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff937779e62800 10000000:01000000:3.0:1789265315.533737:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789265315.533741:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff937779e62800 10000000:01000000:3.0:1789265315.533743:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789265315.533746:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff937779e62800 from 1 10000000:01000000:3.0:1789265315.533748:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789265315.533764:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 00000000cd5d9bb5/0xbbfdc9019c1d3537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.533771:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 00000000cd5d9bb5/0xbbfdc9019c1d3537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.533777:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 00000000cd5d9bb5/0xbbfdc9019c1d3537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265315.533787:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578861696:0@lo:101: 00000100:00100000:3.0:1789265315.533810:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.533832:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efce6434 going to sleep for 11 seconds 00000100:00100000:0.0:1789265315.533889:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578861696 00000100:00100000:0.0:1789265315.533893:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578861696 00000100:00100000:0.0:1789265315.533920:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265315.533925:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4a2a7ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+6:6495:x1876180578861696:12345-0@lo:101: 00010000:00010000:0.0:1789265315.533933:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265315.533944:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c2ed78a6/0xbbfdc9019c1d353e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3537 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.533957:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c2ed78a6/0xbbfdc9019c1d353e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3537 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.533964:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c2ed78a6/0xbbfdc9019c1d353e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3537 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.533971:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c2ed78a6, rc 0) 00000100:00100000:0.0:1789265315.533998:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4a2a7ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+7:6495:x1876180578861696:12345-0@lo:101: Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265315.534003:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265315.534717:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578861696:0@lo:101: 00010000:00010000:3.0:1789265315.534732:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 00000000cd5d9bb5/0xbbfdc9019c1d3537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.534751:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 00000000cd5d9bb5/0xbbfdc9019c1d3537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265315.534765:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789265315.534818:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 00000000cd5d9bb5/0xbbfdc9019c1d3537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.534826:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 00000000cd5d9bb5/0xbbfdc9019c1d3537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265315.534832:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789265315.534836:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265315.534841:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff937779e62800 10000000:01000000:3.0:1789265315.534845:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789265315.534848:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789265315.534850:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789265315.534890:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.534898:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.534905:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265315.534919:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578861824:0@lo:101: 00000100:00100000:3.0:1789265315.534956:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.535036:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efce6434 going to sleep for 11 seconds 00000100:00100000:0.0:1789265315.535112:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578861824 00000100:00100000:0.0:1789265315.535195:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578861824 00000100:00100000:0.0:1789265315.535264:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265315.535271:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d6c1036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+7:6495:x1876180578861824:12345-0@lo:101: 00010000:00010000:0.0:1789265315.535281:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265315.535289:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000069fe98/0xbbfdc9019c1d354c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3545 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.535305:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000069fe98/0xbbfdc9019c1d354c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3545 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.535312:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000069fe98/0xbbfdc9019c1d354c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3545 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.535325:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000069fe98, rc 0) 00000100:00100000:0.0:1789265315.535364:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d6c1036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+8:6495:x1876180578861824:12345-0@lo:101: Request processed in 93us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265315.535370:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789265315.535423:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578861824:0@lo:101: 00010000:00010000:3.0:1789265315.535432:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d354c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.535438:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d354c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265315.535482:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578861952:0@lo:501: 00000100:00100000:3.0:1789265315.535503:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.535595:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efce6434 going to sleep for 11 seconds 00000100:00100000:2.0:1789265315.535669:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578861952 00000100:00100000:2.0:1789265315.535674:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578861952 00000100:00100000:2.0:1789265315.535696:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265315.535702:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9780aed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+8:6495:x1876180578861952:12345-0@lo:501: 00000100:00100000:2.0:1789265315.535842:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9780aed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+9:6495:x1876180578861952:12345-0@lo:501: Request processed in 139us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.535849:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265315.535963:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578861952:0@lo:501: 00000100:00100000:3.0:1789265315.535989:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578862080:0@lo:503: 00000100:00100000:3.0:1789265315.536023:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.536038:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efce6434 going to sleep for 11 seconds 00000100:00100000:2.0:1789265315.536082:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578862080 00000100:00100000:2.0:1789265315.536086:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578862080 00000100:00100000:2.0:1789265315.536101:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265315.536106:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edc29473 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+9:6495:x1876180578862080:12345-0@lo:503: 00000100:00100000:2.0:1789265315.536274:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edc29473 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+9:6495:x1876180578862080:12345-0@lo:503: Request processed in 168us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.536288:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265315.536362:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578862080:0@lo:503: 00000100:00100000:3.0:1789265315.536767:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:6541:1876180578862208:0@lo:502: 00000100:00100000:3.0:1789265315.536803:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.536825:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3076d5c going to sleep for 11 seconds 00000100:00100000:2.0:1789265315.536887:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578862208 00000100:00100000:2.0:1789265315.536892:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578862208 00000100:00100000:2.0:1789265315.536923:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265315.536929:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a3b056 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+9:6541:x1876180578862208:12345-0@lo:502: 00000100:00100000:2.0:1789265315.537010:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a3b056 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+9:6541:x1876180578862208:12345-0@lo:502: Request processed in 81us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.537016:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265315.537110:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:6541:1876180578862208:0@lo:502: 00000020:01000000:3.0:1789265315.537217:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265315.537228:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265315.537231:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789265315.537236:0:6541:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789265315.537239:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265315.537253:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ff75b211) 00000020:00000080:3.0:1789265315.537278:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789265315.537287:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789265315.537384:0:6541:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789265315.537392:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d355a 00000020:00000080:3.0:1789265315.537609:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789265315.537613:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265315.537616:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265315.537618:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789265315.537620:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265315.537624:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265315.537625:0:6541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789265315.537628:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265315.537634:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000002b04f754) 00000020:00000080:3.0:1789265315.537642:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789265315.537646:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789265315.537648:0:6541:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789265315.537650:0:6541:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789265315.537657:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789265315.537701:0:6541:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000019c0391e from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789265315.537713:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000010bb8e60) 00000020:00000080:3.0:1789265315.537721:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789265315.537794:0:6541:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789265315.537800:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbbfdc9019c1d356f 00000020:00000080:3.0:1789265315.537914:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789265315.537920:0:6541:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789265315.537924:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbbfdc9019c1d3576 00080000:01000000:3.0:1789265315.537929:0:6541:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789265315.537933:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d357d 00080000:10000000:3.0:1789265315.539952:0:6541:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789265315.540455:0:6541:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789265315.544020:0:6541:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789265315.596977:0:6541:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789265315.597408:0:6541:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789265315.599802:0:6541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789265315.600210:0:6541:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789265315.603080:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e218120e) 00000020:00000080:2.0:1789265315.603113:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789265315.603313:0:6541:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789265315.603333:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d358b 00000020:00000080:1.0:1789265315.605473:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789265315.606594:0:6541:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1789265315.613013:0:6541:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1789265315.619404:0:6541:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1789265315.621789:0:6541:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1789265315.627551:0:6541:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1789265315.629190:0:6541:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1789265315.630597:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbbfdc9019c1d3592 00000020:00000080:2.0:1789265315.630825:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789265315.630838:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265315.630845:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265315.630848:0:6541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789265315.630851:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265315.630855:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265315.630881:0:6541:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265315.630892:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265315.630894:0:6541:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789265315.630897:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265315.630899:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265315.630900:0:6541:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789265315.630903:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265315.630907:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265315.630908:0:6541:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789265315.630912:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789265315.630965:0:6541:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789265315.631041:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000206aa173 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:6541:1876180578862336:0@lo:502: 00000100:00100000:2.0:1789265315.631477:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265315.631537:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set 000000007881e29d going to sleep for 11 seconds 00000100:00100000:0.0:1789265315.631600:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578862336 00000100:00100000:0.0:1789265315.631608:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578862336 00000100:00100000:0.0:1789265315.631683:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265315.631694:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000816b8ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+9:6541:x1876180578862336:12345-0@lo:502: 00000100:00100000:0.0:1789265315.631833:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000816b8ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+9:6541:x1876180578862336:12345-0@lo:502: Request processed in 140us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265315.631841:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265315.631963:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000206aa173 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:6541:1876180578862336:0@lo:502: 00000020:01000000:1.0:1789265315.631995:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265315.632000:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265315.632002:0:6541:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1789265315.632007:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789265315.632326:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789265315.632353:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789265315.632374:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d354c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.632393:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d354c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265315.632401:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff937779e62800 from 1 10000000:01000000:3.0:1789265315.632404:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789265315.632429:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.632436:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.632445:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265315.632460:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578862464:0@lo:101: 00000100:00100000:3.0:1789265315.632494:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.632525:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000735878a8 going to sleep for 11 seconds 00000100:00100000:1.0:1789265315.632572:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578862464 00000100:00100000:1.0:1789265315.632577:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578862464 00000100:00100000:1.0:1789265315.632614:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265315.632621:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e9e16c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+9:6495:x1876180578862464:12345-0@lo:101: 00010000:00010000:1.0:1789265315.632630:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265315.632641:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c075262/0xbbfdc9019c1d35a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3599 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.632660:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c075262/0xbbfdc9019c1d35a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3599 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.632683:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c075262/0xbbfdc9019c1d35a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3599 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.632690:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c075262, rc 0) 00000100:00100000:1.0:1789265315.632732:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e9e16c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+10:6495:x1876180578862464:12345-0@lo:101: Request processed in 111us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.632738:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265315.632835:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578862464:0@lo:101: 00010000:00010000:3.0:1789265315.632846:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d35a0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.632854:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d35a0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265315.633683:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578862592:0@lo:256: 00000100:00100000:3.0:1789265315.633729:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.633795:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000735878a8 going to sleep for 11 seconds 00000100:00100000:1.0:1789265315.633837:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578862592 00000100:00100000:1.0:1789265315.633843:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578862592 00000100:00100000:1.0:1789265315.634044:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265315.634053:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003165b955 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+10:6495:x1876180578862592:12345-0@lo:256: 20000000:01000000:1.0:1789265315.634069:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789265315.634075:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789265315.634162:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003165b955 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+10:6495:x1876180578862592:12345-0@lo:256: Request processed in 111us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.634170:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265315.634232:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578862592:0@lo:256: 10000000:01000000:3.0:1789265315.634825:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789265315.634851:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d35a0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.634891:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d35a0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265315.634899:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff937779e62800 from 1 10000000:01000000:3.0:1789265315.634902:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265315.634929:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.634935:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.634944:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265315.634960:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578862720:0@lo:101: 00000100:00100000:3.0:1789265315.634997:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.635444:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000735878a8 going to sleep for 11 seconds 00000100:00100000:0.0:1789265315.635477:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578862720 00000100:00100000:0.0:1789265315.635484:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578862720 00000100:00100000:1.0:1789265315.635545:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265315.635553:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007952653 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+10:6495:x1876180578862720:12345-0@lo:101: 00010000:00010000:1.0:1789265315.635565:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265315.635578:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b76eb863/0xbbfdc9019c1d35ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d35a7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.635597:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b76eb863/0xbbfdc9019c1d35ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d35a7 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.635607:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b76eb863/0xbbfdc9019c1d35ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d35a7 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.635630:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b76eb863, rc 0) 00000100:00100000:1.0:1789265315.635674:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007952653 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+11:6495:x1876180578862720:12345-0@lo:101: Request processed in 123us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.635681:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265315.635743:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578862720:0@lo:101: 00010000:00010000:3.0:1789265315.635757:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d35ae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.635765:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d35ae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265315.635841:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578862848:0@lo:501: 00000100:00100000:3.0:1789265315.635934:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.636355:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000735878a8 going to sleep for 11 seconds 00000100:00100000:2.0:1789265315.636397:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578862848 00000100:00100000:2.0:1789265315.636402:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578862848 00000100:00100000:2.0:1789265315.636431:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265315.636437:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d9dc04c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+11:6495:x1876180578862848:12345-0@lo:501: 00000100:00100000:2.0:1789265315.636620:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d9dc04c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+11:6495:x1876180578862848:12345-0@lo:501: Request processed in 183us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.636628:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265315.636742:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578862848:0@lo:501: 00000100:00100000:3.0:1789265315.636775:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578862976:0@lo:503: 00000100:00100000:3.0:1789265315.636818:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265315.636840:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000735878a8 going to sleep for 11 seconds 00000100:00100000:2.0:1789265315.636916:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578862976 00000100:00100000:2.0:1789265315.636921:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578862976 00000100:00100000:2.0:1789265315.636940:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265315.636946:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be231116 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+11:6495:x1876180578862976:12345-0@lo:503: 00000040:00080000:2.0:1789265315.636978:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265315.637016:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be231116 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+11:6495:x1876180578862976:12345-0@lo:503: Request processed in 70us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.637023:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265315.637097:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578862976:0@lo:503: 00000040:00080000:3.0:1789265315.638199:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789265315.638551:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789265315.638584:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265315.638644:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d35ae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.638658:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d35ae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265315.638723:0:6495:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789265315.638727:0:6495:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff937779e62800 10000000:01000000:2.0:1789265315.638730:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff937779e62800 10000000:01000000:2.0:1789265315.638734:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789265315.638740:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff937779e62800 from 1 10000000:01000000:2.0:1789265315.638743:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265315.638776:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.638784:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.638793:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265315.638813:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fad7e111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578863104:0@lo:101: 00000100:00100000:2.0:1789265315.638909:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265315.638944:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 0000000078d38831 going to sleep for 11 seconds 00000100:00100000:3.0:1789265315.639010:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578863104 00000100:00100000:3.0:1789265315.639017:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578863104 00000100:00100000:3.0:1789265315.639061:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265315.639069:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac27f243 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+11:6495:x1876180578863104:12345-0@lo:101: 00010000:00010000:3.0:1789265315.639080:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265315.639093:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ec0690ee/0xbbfdc9019c1d35bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d35b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.639113:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec0690ee/0xbbfdc9019c1d35bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d35b5 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.639238:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ec0690ee/0xbbfdc9019c1d35bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d35b5 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265315.639247:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ec0690ee, rc 0) 00000100:00100000:3.0:1789265315.639295:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac27f243 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+12:6495:x1876180578863104:12345-0@lo:101: Request processed in 227us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265315.639312:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265315.639386:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fad7e111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578863104:0@lo:101: 00010000:00010000:2.0:1789265315.639399:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d35bc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.639407:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d35bc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265315.639466:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fad7e111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578863232:0@lo:501: 00000100:00100000:2.0:1789265315.639491:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265315.639516:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 0000000078d38831 going to sleep for 11 seconds 00000100:00100000:3.0:1789265315.639611:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578863232 00000100:00100000:3.0:1789265315.639615:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578863232 00000100:00100000:3.0:1789265315.639646:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265315.639652:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013a1e837 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+12:6495:x1876180578863232:12345-0@lo:501: 00000100:00100000:3.0:1789265315.639769:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013a1e837 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+12:6495:x1876180578863232:12345-0@lo:501: Request processed in 118us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265315.639776:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789265315.639883:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fad7e111 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578863232:0@lo:501: 00000100:00100000:1.0:1789265315.639913:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e7b7c621 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578863360:0@lo:503: 00000100:00100000:1.0:1789265315.639956:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.639973:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bfe87e2e going to sleep for 11 seconds 00000100:00100000:3.0:1789265315.640063:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578863360 00000100:00100000:3.0:1789265315.640067:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578863360 00000100:00100000:3.0:1789265315.640098:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265315.640104:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba26fb73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+12:6495:x1876180578863360:12345-0@lo:503: 00000100:00100000:3.0:1789265315.640302:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba26fb73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+12:6495:x1876180578863360:12345-0@lo:503: Request processed in 199us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265315.640309:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265315.640492:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e7b7c621 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578863360:0@lo:503: 00000100:00100000:1.0:1789265315.640777:0:6546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:6546:1876180578863488:0@lo:502: 00000100:00100000:1.0:1789265315.640827:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.641000:0:6546:0:(client.c:2715:ptlrpc_set_wait()) set 000000007cb72a28 going to sleep for 11 seconds 00000100:00100000:2.0:1789265315.641030:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578863488 00000100:00100000:2.0:1789265315.641034:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578863488 00000100:00100000:2.0:1789265315.641091:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265315.641098:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063713cc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+12:6546:x1876180578863488:12345-0@lo:502: 00000100:00100000:2.0:1789265315.641312:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063713cc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+12:6546:x1876180578863488:12345-0@lo:502: Request processed in 214us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.641319:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265315.641390:0:6546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:6546:1876180578863488:0@lo:502: 00000020:01000004:1.0:1789265315.641449:0:6546:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789265315.641464:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000000de63bfa) 00000020:00000080:1.0:1789265315.641481:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1789265315.641567:0:6546:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000019c0391e from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789265315.641571:0:6546:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000019c0391e from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789265315.641574:0:6546:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000019c0391e 4 00010000:00080000:1.0:1789265315.641607:0:6546:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000067339363@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1789265315.643718:0:6546:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789265315.644040:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789265315.644084:0:6546:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789265315.644098:0:6546:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbbfdc9019c1d35ca 00000100:00080000:1.0:1789265315.644107:0:6546:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265315.644111:0:6546:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000067339363 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1789265315.644262:0:6546:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ae9db366 x1876180578863616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265315.644283:0:6546:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789265315.644637:0:6546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a10d15da pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:6546:1876180578863744:0@lo:502: 00000100:00100000:1.0:1789265315.644715:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265315.644749:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578863744 00000100:00100000:1.0:1789265315.644755:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578863744 00000100:00100000:1.0:1789265315.644793:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265315.644801:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a1982ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+12:6546:x1876180578863744:12345-0@lo:502: 00000100:00100000:1.0:1789265315.644932:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a1982ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+12:6546:x1876180578863744:12345-0@lo:502: Request processed in 131us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.644940:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265315.644993:0:6546:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d01180a going to sleep for 11 seconds 00000100:00100000:1.0:1789265315.645011:0:6546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a10d15da pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:6546:1876180578863744:0@lo:502: 00000040:00080000:1.0:1789265315.645036:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1789265315.645236:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180578863616:0@lo:38: 00000100:00100000:2.0:1789265315.645272:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789265315.645315:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789265315.645342:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789265315.645354:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d35bc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.645364:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d35bc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789265315.645410:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789265315.645412:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789265315.645414:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265315.645415:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265315.645416:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265315.645418:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265315.645422:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789265315.645424:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789265315.645425:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265315.645426:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265315.645427:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265315.645428:0:6495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789265315.645432:0:6495:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789265315.645434:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789265315.645435:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789265315.645436:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265315.645437:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265315.645438:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265315.645439:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265315.645440:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789265315.645441:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789265315.645442:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265315.645442:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265315.645443:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265315.645444:0:6495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789265315.645456:0:6495:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789265315.645464:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010b23154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578863872:0@lo:253: 00000100:00100000:2.0:1789265315.645501:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265315.645513:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ec8bf66 going to sleep for 11 seconds 00000100:00100000:2.0:1789265315.645528:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578863872 00000100:00100000:2.0:1789265315.645531:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578863872 00000100:00100000:2.0:1789265315.645554:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265315.645558:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3566454 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+12:6495:x1876180578863872:12345-0@lo:253: 20000000:01000000:2.0:1789265315.645584:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789265315.645598:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789265315.646943:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578863616 00000100:00100000:1.0:1789265315.646954:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578863616 00000100:00100000:1.0:1789265315.646992:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265315.646999:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4a1c6c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876180578863616:12345-0@lo:38: 00000100:00100000:1.0:1789265315.647075:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4a1c6c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876180578863616:12345-0@lo:38: Request processed in 76us (1803us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789265315.647082:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265315.648230:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265315.648241:0:3642:0:(import.c:65:import_set_state_nolock()) 0000000067339363 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265315.648248:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789265315.648252:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180578863616:0@lo:38: 20000000:01000000:0.0:1789265315.651912:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789265315.651934:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789265315.652186:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789265315.652192:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789265315.652212:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.652235:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005c075262/0xbbfdc9019c1d35a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3599 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.652261:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.652304:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005c075262/0xbbfdc9019c1d35a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3599 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.652321:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005c075262/0xbbfdc9019c1d35a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3599 expref: 12 pid: 6514 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265315.652337:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035dfb89a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876180578864000:0@lo:104: 00000100:00100000:2.0:1789265315.652410:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265315.652464:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 000000000896cd5c going to sleep for 11 seconds 00000100:00100000:0.0:1789265315.652555:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578864000 00000100:00100000:0.0:1789265315.652564:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578864000 00000100:00100000:0.0:1789265315.652618:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265315.652626:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000979d327c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:6535:x1876180578864000:12345-0@lo:104: 00010000:00010000:0.0:1789265315.652640:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d35a0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.652692:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265315.652698:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000979d327c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:6535:x1876180578864000:12345-0@lo:104: Request processed in 73us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265315.652704:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265315.652743:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035dfb89a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876180578864000:0@lo:104: 00010000:00010000:0.0:1789265315.652770:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.652818:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265315.652824:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d35a0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.652831:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005057da88 already unused, calling callback (000000003dbb8eda) 10000000:00010000:2.0:1789265315.652834:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d35a0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.652841:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d35a0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265315.652847:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d35a0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265315.652852:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265315.652910:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d35a0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.652926:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265315.652944:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d35a0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.652950:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3599 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d35a0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265315.652966:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265315.652967:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265315.652969:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265315.653016:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265315.653024:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c5b3934 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578864128:0@lo:103: 00000100:00100000:2.0:1789265315.653050:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265315.653114:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3566454 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+12:6495:x1876180578863872:12345-0@lo:253: Request processed in 7555us (7613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265315.653246:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265315.653287:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010b23154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:6495:1876180578863872:0@lo:253: 10000000:01000000:2.0:1789265315.653297:0:6495:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789265315.653300:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789265315.653303:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789265315.653304:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265315.653305:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265315.653306:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265315.653307:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265315.653309:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789265315.653310:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789265315.653311:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789265315.653312:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789265315.653314:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265315.653316:0:6495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789265315.653326:0:6495:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789265315.660287:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578864128 00000100:00100000:1.0:1789265315.660306:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578864128 00010000:00010000:1.0:1789265315.660354:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005c075262/0xbbfdc9019c1d35a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3599 expref: 12 pid: 6514 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265315.660402:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265315.660412:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d4687b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+12:3643:x1876180578864128:12345-0@lo:103: 00010000:00010000:1.0:1789265315.660427:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265315.660432:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005c075262/0xbbfdc9019c1d35a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3599 expref: 12 pid: 6514 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.660443:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005c075262/0xbbfdc9019c1d35a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3599 expref: 12 pid: 6514 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.660461:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005c075262/0xbbfdc9019c1d35a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3599 expref: 12 pid: 6514 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.660477:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.660485:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789265315.660501:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008310862s 00010000:00010000:1.0:1789265315.660505:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.660511:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.660517:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.660534:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.660539:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000036598cb0 already unused, calling callback (00000000f2b4c23c) 00010000:00010000:1.0:1789265315.660542:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.660550:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.660568:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265315.660581:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265315.660667:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d4687b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+11:3643:x1876180578864128:12345-0@lo:103: Request processed in 257us (7615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265315.660674:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265315.660731:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c5b3934 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578864128:0@lo:103: 00010000:00010000:0.0:1789265315.660834:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.660843:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265315.660848:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000036598cb0/0xbbfdc9019c1d35d1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789265315.662811:0:6495:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1789265315.663078:0:6495:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789265315.663473:0:6495:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1789265315.663644:0:6495:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789265315.663843:0:6495:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1789265315.664579:0:6495:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789265315.665408:0:6495:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1789265315.665577:0:6495:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789265315.665779:0:6495:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1789265315.666011:0:6495:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789265315.666227:0:6495:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1789265315.666381:0:6495:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1789265315.669524:0:6495:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789265315.677457:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789265315.677648:0:6551:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789265315.677652:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789265315.677739:0:6552:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789265315.679573:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789265315.679696:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789265315.680423:0:6495:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789265315.680434:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789265315.680558:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265315.681618:0:6495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789265315.682366:0:6495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789265315.682408:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789265315.682607:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789265315.682829:0:6495:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:1.0:1789265315.684773:0:6552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265315.688742:0:6552:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789265315.688826:0:6552:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789265315.688831:0:6552:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1789265315.690228:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789265315.690378:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789265315.690558:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789265315.690709:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789265315.690842:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789265315.691088:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789265315.691337:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789265315.691481:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789265315.691633:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789265315.691766:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789265315.692089:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789265315.692373:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789265315.692511:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789265315.692647:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789265315.692801:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789265315.693198:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789265315.693465:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789265315.693599:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789265315.693725:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789265315.693847:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789265315.694208:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789265315.694377:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789265315.694529:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789265315.694670:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789265315.694814:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789265315.695085:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789265315.695286:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789265315.695402:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789265315.695531:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789265315.695685:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789265315.695854:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789265315.696260:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789265315.696456:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1789265315.699494:0:6495:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789265315.699538:0:6495:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa605819af988 00100000:10000000:3.0:1789265315.699548:0:6495:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789265315.700301:0:6495:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789265315.700315:0:6495:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789265315.700331:0:6495:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789265315.700356:0:6495:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789265315.701301:0:6495:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265315.701490:0:6495:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789265316.416780:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265317.427394:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265318.451821:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265319.482768:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265320.037794:0:6796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789265320.501631:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265320.836313:0:6848:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265320.836535:0:6848:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:0.0:1789265320.948689:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789265320.948707:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789265320.948710:0:8:0:(import.c:65:import_set_state_nolock()) 0000000067339363 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265320.948722:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000067339363 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265320.948743:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000088e10ccf x1876180578864384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265320.948758:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbd66121 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578864256:0@lo:400: 00000100:00100000:0.0:1789265320.948774:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000088e10ccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180578864384:0@lo:38: 00000100:00100000:2.0:1789265320.949302:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265320.949559:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578864256 00000100:00100000:1.0:1789265320.949569:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578864256 00000100:00100000:1.0:1789265320.949622:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789265320.949631:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe8b4928 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+11:3645:x1876180578864256:12345-0@lo:400: 00000100:00100000:1.0:1789265320.949713:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe8b4928 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+11:3645:x1876180578864256:12345-0@lo:400: Request processed in 83us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265320.949720:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265320.949769:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbd66121 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578864256:0@lo:400: 00000100:00100000:0.0:1789265320.954111:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265320.954928:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578864384 00000100:00100000:3.0:1789265320.954951:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578864384 00000100:00100000:3.0:1789265320.955011:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265320.955019:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d70bb99 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876180578864384:12345-0@lo:38: 00010000:00080000:3.0:1789265320.955049:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:3.0:1789265320.955099:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbbfdc9019c1d35d8 00000004:00100000:3.0:1789265320.955147:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789265320.955266:0:6521:0:(import.c:65:import_set_state_nolock()) 000000006f69d533 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265320.955344:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d70bb99 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180578864384:12345-0@lo:38: Request processed in 325us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265320.955351:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265320.955653:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000088e10ccf x1876180578864384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265320.955670:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789265320.955753:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789265320.955759:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789265320.955761:0:3642:0:(import.c:65:import_set_state_nolock()) 0000000067339363 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789265320.955768:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000088e10ccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180578864384:0@lo:38: 00010000:00010000:2.0:1789265321.524462:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265322.547612:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265323.575144:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789265323.609110:0:6950:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265323.609297:0:6950:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265324.595209:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265325.045438:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789265325.045447:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff937779e62800 from 3 10000000:01000000:2.0:1789265325.045452:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789265325.045498:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265325.045512:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265325.045523:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265325.045571:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010b23154 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578864512:0@lo:101: 00000100:00100000:2.0:1789265325.045642:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265325.045809:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac9a48de going to sleep for 11 seconds 00000100:00100000:2.0:1789265325.045832:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578864512 00000100:00100000:2.0:1789265325.045839:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578864512 00000100:00100000:2.0:1789265325.046760:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265325.046772:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3a59a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+11:6516:x1876180578864512:12345-0@lo:101: 00010000:00010000:2.0:1789265325.046787:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265325.046801:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000448bcc97/0xbbfdc9019c1d35e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d35df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265325.046825:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000448bcc97/0xbbfdc9019c1d35e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d35df expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265325.046834:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000448bcc97/0xbbfdc9019c1d35e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d35df expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265325.046843:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000448bcc97, rc 0) 00000100:00100000:2.0:1789265325.047773:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3a59a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+12:6516:x1876180578864512:12345-0@lo:101: Request processed in 1002us (2128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265325.047782:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265325.047846:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010b23154 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578864512:0@lo:101: 00010000:00010000:2.0:1789265325.048419:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d35e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265325.048432:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d35e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265325.048502:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010b23154 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578864640:0@lo:256: 00000100:00100000:2.0:1789265325.048545:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265325.049462:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac9a48de going to sleep for 11 seconds 00000100:00100000:2.0:1789265325.050759:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578864640 00000100:00100000:2.0:1789265325.050772:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578864640 00000100:00100000:2.0:1789265325.050824:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265325.050833:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000740d9d16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+12:6516:x1876180578864640:12345-0@lo:256: 20000000:01000000:2.0:1789265325.050952:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789265325.050969:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789265325.050972:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789265325.052084:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000740d9d16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+12:6516:x1876180578864640:12345-0@lo:256: Request processed in 1248us (3534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265325.052095:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265325.052665:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010b23154 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578864640:0@lo:256: 10000000:01000000:3.0:1789265325.053045:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789265325.053055:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d35e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265325.053067:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d35e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265325.619216:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265326.070264:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff45b7e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578864768:0@lo:400: 00000100:00100000:0.0:1789265326.070344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265326.070434:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000681e54de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578864896:0@lo:400: 00000100:00100000:0.0:1789265326.070478:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265326.070528:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578864768 00000100:00100000:0.0:1789265326.070665:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578864768 00000100:00100000:0.0:1789265326.070715:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265326.070723:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000314602b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+12:3646:x1876180578864768:12345-0@lo:400: 00000100:00100000:0.0:1789265326.070778:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000314602b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+12:3646:x1876180578864768:12345-0@lo:400: Request processed in 57us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265326.070785:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265326.070832:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff45b7e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578864768:0@lo:400: 00000100:00100000:2.0:1789265326.076561:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578864896 00000100:00100000:2.0:1789265326.076576:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578864896 00000100:00100000:2.0:1789265326.076651:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265326.076660:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000661f1355 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578864896:12345-0@lo:400: 00000100:00100000:2.0:1789265326.076757:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000661f1355 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578864896:12345-0@lo:400: Request processed in 99us (6279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265326.076764:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789265326.080612:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000681e54de x1876180578864896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265326.080633:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000681e54de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578864896:0@lo:400: 00010000:00010000:0.0:1789265326.643545:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265327.668156:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265328.695708:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265329.720828:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265330.739020:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265331.194237:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578865024:0@lo:400: 00000100:00100000:2.0:1789265331.194304:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265331.194375:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4fcf911 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578865152:0@lo:400: 00000100:00100000:2.0:1789265331.194404:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265331.194446:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578865024 00000100:00100000:2.0:1789265331.194460:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578865024 00000100:00100000:2.0:1789265331.194508:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265331.194514:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014b41ecd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+12:3644:x1876180578865024:12345-0@lo:400: 00000100:00100000:2.0:1789265331.194557:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014b41ecd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+12:3644:x1876180578865024:12345-0@lo:400: Request processed in 43us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265331.194564:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265331.194594:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578865152 00000100:00100000:2.0:1789265331.194597:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578865152 00000100:00100000:2.0:1789265331.194623:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265331.194629:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003aa7d412 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578865152:12345-0@lo:400: 00000100:00100000:2.0:1789265331.194660:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003aa7d412 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578865152:12345-0@lo:400: Request processed in 32us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265331.194666:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265331.194717:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e4fcf911 x1876180578865152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265331.194731:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4fcf911 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578865152:0@lo:400: 00000100:00100000:2.0:1789265331.194754:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578865024:0@lo:400: 00010000:00010000:1.0:1789265331.768743:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265332.787016:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265333.811153:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789265334.030902:0:7448:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789265334.030906:0:7448:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789265334.030908:0:7448:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789265334.037728:0:7448:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008a59668c 00000020:01000004:2.0:1789265334.037752:0:7448:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1789265334.037764:0:7448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789265334.037778:0:7448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000e4a37a67) 00000020:00000080:2.0:1789265334.037794:0:7448:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789265334.162317:0:7448:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1789265334.162397:0:7448:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1789265334.204767:0:7448:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789265334.205071:0:7448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789265334.205083:0:7448:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789265334.205094:0:7448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbbfdc9019c1d35f4 00000020:01000004:0.0:1789265334.205102:0:7448:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789265334.205123:0:7448:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789265334.205127:0:7448:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789265334.205132:0:7448:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789265334.205158:0:7448:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789265334.205161:0:7448:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1789265334.236401:0:7448:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789265334.236448:0:7448:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.142@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1789265334.236455:0:7448:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789265334.236457:0:7448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789265334.236459:0:7448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265334.236460:0:7448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265334.236461:0:7448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265334.236463:0:7448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265334.236464:0:7448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265334.236466:0:7448:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265334.236468:0:7448:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265334.236469:0:7448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265334.236470:0:7448:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265334.236474:0:7448:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1789265334.236476:0:7448:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265334.236477:0:7448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789265334.236478:0:7448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265334.236479:0:7448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265334.236480:0:7448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265334.236481:0:7448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265334.236482:0:7448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265334.236483:0:7448:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265334.236484:0:7448:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265334.236485:0:7448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265334.236492:0:7448:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265334.236528:0:7448:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789265334.236549:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578865280:0@lo:253: 00000100:00100000:1.0:1789265334.236638:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.236899:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084a6418b going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.239277:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578865280 00000100:00100000:0.0:1789265334.239293:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578865280 00000100:00100000:0.0:1789265334.239363:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265334.239373:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cfb6e5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+12:7448:x1876180578865280:12345-0@lo:253: 20000000:01000000:0.0:1789265334.239430:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789265334.239436:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1789265334.239442:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1789265334.239446:0:6514:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1789265334.239507:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1789265334.239827:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265334.240234:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789265334.240252:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789265334.240273:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789265334.240292:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789265334.240309:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789265334.240373:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1789265334.240381:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1789265334.240393:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1789265334.240399:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1789265334.240410:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1789265334.240416:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1789265334.240428:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789265334.240444:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789265334.240548:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1789265334.240557:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:0.0:1789265334.240570:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1789265334.240576:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789265334.240587:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1789265334.240592:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:0.0:1789265334.240601:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1789265334.240606:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789265334.240616:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789265334.240630:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789265334.240641:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789265334.240746:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1789265334.240756:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1789265334.240769:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789265334.240786:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789265334.240804:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1789265334.240810:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1789265334.240824:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789265334.240845:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789265334.241564:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1789265334.241604:0:6514:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789265334.241610:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1789265334.249781:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789265334.250201:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789265334.250239:0:6514:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.142@tcp for mdt 20000000:01000000:0.0:1789265334.250242:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:0.0:1789265334.250259:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789265334.250266:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789265334.250280:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789265334.250285:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:0.0:1789265334.250301:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789265334.250309:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1789265334.250324:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1789265334.250341:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1789265334.250392:0:6514:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1789265334.250401:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1789265334.250927:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1789265334.251222:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789265334.251241:0:6514:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.142@tcp for mdt 20000000:01000000:1.0:1789265334.251243:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:1.0:1789265334.251258:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789265334.251264:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789265334.251276:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789265334.251281:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:1.0:1789265334.251293:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789265334.251299:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1789265334.251311:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789265334.251325:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1789265334.251345:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789265334.251348:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789265334.251351:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789265334.251397:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789265334.251399:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789265334.256831:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789265334.257371:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789265334.257392:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789265334.257654:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1789265334.257679:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1789265334.257695:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1789265334.257785:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789265334.257789:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789265334.258475:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789265334.258501:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789265334.258516:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789265334.258783:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789265334.258815:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789265334.258839:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789265334.259160:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789265334.259163:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789265334.259418:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789265334.259440:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789265334.259451:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1789265334.259609:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789265334.259635:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789265334.259653:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1789265334.259667:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789265334.259683:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789265334.259689:0:6514:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789265334.259765:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789265334.260676:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1789265334.261910:0:6514:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789265334.287072:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789265334.287104:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.287124:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fcafb728/0xbbfdc9019c1d3530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3529 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.287131:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000069fe98/0xbbfdc9019c1d354c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3545 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.287137:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ec0690ee/0xbbfdc9019c1d35bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d35b5 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.287144:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.287188:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ec0690ee/0xbbfdc9019c1d35bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d35b5 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.287204:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ec0690ee/0xbbfdc9019c1d35bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d35b5 expref: 12 pid: 6512 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265334.287219:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578865408:0@lo:104: 00000100:00100000:3.0:1789265334.287295:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265334.287390:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000069fe98/0xbbfdc9019c1d354c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3545 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.287464:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578865408 00000100:00100000:0.0:1789265334.287473:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578865408 00000100:00100000:0.0:1789265334.287527:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265334.287542:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a925537 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+3:6514:x1876180578865408:12345-0@lo:104: 00010000:00010000:0.0:1789265334.287555:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d35bc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.287612:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265334.287617:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a925537 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+3:6514:x1876180578865408:12345-0@lo:104: Request processed in 77us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.287624:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789265334.287738:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265334.287744:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d35bc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.287752:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000008b718da already unused, calling callback (000000003dbb8eda) 10000000:00010000:2.0:1789265334.287755:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d35bc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.287761:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d35bc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265334.287767:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d35bc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265334.287773:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265334.287810:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d35bc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.287817:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265334.287834:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d35bc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.287840:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 0000000008b718da/0xbbfdc9019c1d35b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d35bc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.287898:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265334.287900:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265334.287908:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265334.287924:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578865664:0@lo:103: 00010000:00010000:3.0:1789265334.287928:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000069fe98/0xbbfdc9019c1d354c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3545 expref: 12 pid: 6512 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265334.287940:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092df39c6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578865536:0@lo:104: 00000100:00100000:2.0:1789265334.288231:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.288329:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578865664 00000100:00100000:1.0:1789265334.288335:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578865664 00000100:00100000:3.0:1789265334.288341:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265334.288359:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ec0690ee/0xbbfdc9019c1d35bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d35b5 expref: 13 pid: 6512 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.288388:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fcafb728/0xbbfdc9019c1d3530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3529 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265334.288396:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265334.288405:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4fcf911 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+13:3646:x1876180578865664:12345-0@lo:103: 00010000:00010000:1.0:1789265334.288415:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265334.288419:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ec0690ee/0xbbfdc9019c1d35bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d35b5 expref: 13 pid: 6512 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265334.288658:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578865536 00000100:00100000:2.0:1789265334.288662:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578865536 00000100:00100000:2.0:1789265334.288692:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265334.288699:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090ed9d22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+3:6514:x1876180578865536:12345-0@lo:104: 00010000:00010000:2.0:1789265334.288707:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d354c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.288747:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265334.288752:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090ed9d22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+3:6514:x1876180578865536:12345-0@lo:104: Request processed in 55us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.288758:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789265334.288774:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265334.288778:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d354c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.288785:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008eb79e95 already unused, calling callback (000000003dbb8eda) 10000000:00010000:2.0:1789265334.288787:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d354c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.288794:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d354c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265334.288800:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d354c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265334.288806:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265334.288937:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d354c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.289021:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265334.289037:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d354c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.289044:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3545 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d354c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.289056:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265334.289057:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265334.289059:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265334.289070:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032cbfe49 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578865920:0@lo:103: 00000100:00100000:2.0:1789265334.289100:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265334.289151:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789265334.289160:0:6506:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789265334.289278:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fcafb728/0xbbfdc9019c1d3530 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3529 expref: 13 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265334.289291:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0c05a08 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578865792:0@lo:104: 00000100:00100000:3.0:1789265334.289320:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.289338:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069799b9e going to sleep for 11 seconds 00000100:00100000:3.0:1789265334.289360:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cf3b018 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578865408:0@lo:104: 00000100:00100000:3.0:1789265334.289369:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092df39c6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578865536:0@lo:104: 00000100:00100000:2.0:1789265334.289646:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578865920 00000100:00100000:2.0:1789265334.289650:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578865920 00010000:00010000:2.0:1789265334.289669:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000069fe98/0xbbfdc9019c1d354c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3545 expref: 14 pid: 6512 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265334.289688:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789265334.289696:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265334.289701:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc65c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+14:3643:x1876180578865920:12345-0@lo:103: 00010000:00010000:2.0:1789265334.289710:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265334.289714:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000069fe98/0xbbfdc9019c1d354c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3545 expref: 14 pid: 6512 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265334.293484:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578865792 00000100:00100000:3.0:1789265334.293499:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578865792 00010000:00010000:1.0:1789265334.293556:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ec0690ee/0xbbfdc9019c1d35bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d35b5 expref: 14 pid: 6512 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265334.293574:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265334.293584:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af574632 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+3:6514:x1876180578865792:12345-0@lo:104: 00010000:00010000:3.0:1789265334.293600:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3530 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.293691:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265334.293697:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af574632 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+3:6514:x1876180578865792:12345-0@lo:104: Request processed in 116us (4377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.293704:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265334.293765:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0c05a08 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578865792:0@lo:104: 00010000:00010000:1.0:1789265334.293771:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ec0690ee/0xbbfdc9019c1d35bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d35b5 expref: 14 pid: 6512 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.293793:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265334.293797:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265334.293837:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4fcf911 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+13:3646:x1876180578865664:12345-0@lo:103: Request processed in 5434us (5605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.293878:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578865664:0@lo:103: 00000100:00100000:1.0:1789265334.294056:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789265334.294060:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000069fe98/0xbbfdc9019c1d354c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3545 expref: 13 pid: 6512 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.294084:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000069fe98/0xbbfdc9019c1d354c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3545 expref: 12 pid: 6512 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.294095:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265334.294141:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc65c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+11:3643:x1876180578865920:12345-0@lo:103: Request processed in 4440us (5041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.294148:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789265334.294171:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265334.294176:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3530 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.294184:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006a718a13 already unused, calling callback (000000003dbb8eda) 10000000:00010000:2.0:1789265334.294187:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3530 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.294194:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3530 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265334.294200:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3530 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265334.294205:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265334.294244:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3530 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.294250:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265334.294264:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3530 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.294269:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 000000006a718a13/0xbbfdc9019c1d3529 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3530 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.294289:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265334.294291:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265334.294292:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265334.294306:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021b7ab43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578866048:0@lo:103: 00000100:00100000:2.0:1789265334.294341:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.296418:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032cbfe49 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578865920:0@lo:103: 00000100:00100000:0.0:1789265334.296477:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578866048 00000100:00100000:0.0:1789265334.296484:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578866048 00010000:00010000:0.0:1789265334.296515:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fcafb728/0xbbfdc9019c1d3530 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3529 expref: 11 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.296562:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265334.296571:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000384bc1b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+11:3644:x1876180578866048:12345-0@lo:103: 00010000:00010000:0.0:1789265334.296584:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265334.296589:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fcafb728/0xbbfdc9019c1d3530 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3529 expref: 11 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.296599:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fcafb728/0xbbfdc9019c1d3530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3529 expref: 11 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.296615:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fcafb728/0xbbfdc9019c1d3530 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3529 expref: 11 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.296631:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.296658:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.296676:0:7460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.296683:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.296689:0:7460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.296695:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.296701:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a9201a77 already unused, calling callback (00000000f2b4c23c) 00010000:00010000:0.0:1789265334.296705:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.296712:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.296733:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.296746:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265334.296906:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021b7ab43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578866048:0@lo:103: 00000100:00100000:0.0:1789265334.296909:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000384bc1b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+10:3644:x1876180578866048:12345-0@lo:103: Request processed in 338us (2565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.296921:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789265334.297530:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.297540:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.297546:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a9201a77/0xbbfdc9019c1d35fb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265334.297565:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789265334.300560:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cfb6e5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+9:7448:x1876180578865280:12345-0@lo:253: Request processed in 61180us (63913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.300575:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789265334.300676:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578865280:0@lo:253: 10000000:01000000:1.0:1789265334.300691:0:7448:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789265334.300695:0:7448:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265334.300696:0:7448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789265334.300698:0:7448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265334.300699:0:7448:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1789265334.300700:0:7448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265334.300702:0:7448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265334.300703:0:7448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265334.300704:0:7448:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789265334.300705:0:7448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265334.300706:0:7448:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789265334.300736:0:7448:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008a59668c from lustre-MDT0001 10000000:01000000:1.0:1789265334.300765:0:7448:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789265334.300767:0:7448:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789265334.300774:0:7448:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93775f68cd28 local copy 10000000:01000000:1.0:1789265334.300777:0:7448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789265334.300812:0:7448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.300822:0:7448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.300830:0:7448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265334.300891:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578866176:0@lo:101: 00000100:00100000:1.0:1789265334.300929:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265334.301098:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578866176 00000100:00100000:2.0:1789265334.301105:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578866176 00000100:00100000:2.0:1789265334.301143:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265334.301150:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bf293a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+9:7448:x1876180578866176:12345-0@lo:101: 00010000:00010000:2.0:1789265334.301163:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265334.301175:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c9042ca5/0xbbfdc9019c1d3609 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3602 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.301197:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9042ca5/0xbbfdc9019c1d3609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3602 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.301218:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c9042ca5/0xbbfdc9019c1d3609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3602 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.301226:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c9042ca5, rc 0) 00000100:00100000:2.0:1789265334.301253:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bf293a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+10:7448:x1876180578866176:12345-0@lo:101: Request processed in 104us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.301258:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789265334.301429:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d8275137 going to sleep for 11 seconds 00000100:00100000:1.0:1789265334.301441:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578866176:0@lo:101: 00010000:00010000:1.0:1789265334.301452:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbbfdc9019c1d3609 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.301460:0:7448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbbfdc9019c1d3609 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265334.301544:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578866304:0@lo:501: 00000100:00100000:1.0:1789265334.301569:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.301590:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d8275137 going to sleep for 11 seconds 00000100:00100000:2.0:1789265334.301636:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578866304 00000100:00100000:2.0:1789265334.301641:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578866304 00000100:00100000:2.0:1789265334.301672:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265334.301677:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b83e5ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+10:7448:x1876180578866304:12345-0@lo:501: 00000100:00100000:2.0:1789265334.301745:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b83e5ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+10:7448:x1876180578866304:12345-0@lo:501: Request processed in 67us (175us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265334.301751:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789265334.302384:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578866304:0@lo:501: 10000000:01000000:1.0:1789265334.302398:0:7448:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789265334.302422:0:7448:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789265334.302427:0:7448:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbbfdc9019c1d3609 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.302435:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbbfdc9019c1d3609 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.302440:0:7448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbbfdc9019c1d3609 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.302462:0:7448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789265334.302488:0:7448:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93774e5c3000 10000000:01000000:1.0:1789265334.302493:0:7448:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789265334.302497:0:7448:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93775f68cd28 10000000:01000000:1.0:1789265334.302499:0:7448:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789265334.302502:0:7448:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93775f68cd28 from 1 10000000:01000000:1.0:1789265334.302505:0:7448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789265334.302523:0:7448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 00000000af48d2a0/0xbbfdc9019c1d3610 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.302530:0:7448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 00000000af48d2a0/0xbbfdc9019c1d3610 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.302538:0:7448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 00000000af48d2a0/0xbbfdc9019c1d3610 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265334.302550:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578866432:0@lo:101: 00000100:00100000:1.0:1789265334.302580:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265334.302639:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265334.302645:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbbfdc9019c1d3609 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.302652:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009c335c2e already unused, calling callback (000000003dbb8eda) 10000000:00010000:2.0:1789265334.302655:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbbfdc9019c1d3609 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.302662:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xbbfdc9019c1d3609 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265334.302668:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xbbfdc9019c1d3609 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265334.302685:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265334.302716:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbbfdc9019c1d3609 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.302722:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265334.302751:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbbfdc9019c1d3609 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.302757:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 000000009c335c2e/0xbbfdc9019c1d3602 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbbfdc9019c1d3609 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.302770:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265334.302771:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265334.302772:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265334.302779:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265334.302789:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fdd7955d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578866560:0@lo:103: 00000100:00100000:2.0:1789265334.302818:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265334.302924:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578866560 00000100:00100000:2.0:1789265334.302929:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578866560 00000100:00100000:2.0:1789265334.302988:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265334.302995:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0174189 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+10:3646:x1876180578866560:12345-0@lo:103: 00010000:00010000:2.0:1789265334.303007:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265334.303022:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c9042ca5/0xbbfdc9019c1d3609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3602 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.303035:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265334.303063:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0174189 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+9:3646:x1876180578866560:12345-0@lo:103: Request processed in 69us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.303077:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265334.303103:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fdd7955d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578866560:0@lo:103: 00000100:00100000:1.0:1789265334.303393:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 00000000659e6909 going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.305597:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578866432 00000100:00100000:0.0:1789265334.305625:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578866432 00000100:00100000:0.0:1789265334.305686:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265334.305703:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050d0bc33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+9:7448:x1876180578866432:12345-0@lo:101: 00010000:00010000:0.0:1789265334.305718:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265334.305737:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000096f3d81a/0xbbfdc9019c1d3617 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3610 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.305765:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000096f3d81a/0xbbfdc9019c1d3617 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3610 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.305776:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000096f3d81a/0xbbfdc9019c1d3617 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3610 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.305785:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000096f3d81a, rc 0) 00000100:00100000:0.0:1789265334.305912:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050d0bc33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+10:7448:x1876180578866432:12345-0@lo:101: Request processed in 219us (3332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.305919:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789265334.306321:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578866432:0@lo:101: 00010000:00010000:1.0:1789265334.306351:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 00000000af48d2a0/0xbbfdc9019c1d3610 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3617 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.306361:0:7448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 00000000af48d2a0/0xbbfdc9019c1d3610 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3617 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265334.306384:0:7448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789265334.306404:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 00000000af48d2a0/0xbbfdc9019c1d3610 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3617 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.306411:0:7448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 00000000af48d2a0/0xbbfdc9019c1d3610 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3617 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265334.306423:0:7448:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93774e5c3000 10000000:01000000:1.0:1789265334.306427:0:7448:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789265334.306431:0:7448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93774e5c3000 from 1 10000000:01000000:1.0:1789265334.306434:0:7448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789265334.306457:0:7448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 0000000034a94fbf/0xbbfdc9019c1d361e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.306464:0:7448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 0000000034a94fbf/0xbbfdc9019c1d361e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.306471:0:7448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 0000000034a94fbf/0xbbfdc9019c1d361e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265334.306490:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578866688:0@lo:101: 00000100:00100000:1.0:1789265334.306530:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.306561:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 00000000659e6909 going to sleep for 11 seconds 00000100:00100000:3.0:1789265334.306767:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578866688 00000100:00100000:3.0:1789265334.306774:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578866688 00000100:00100000:3.0:1789265334.306825:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789265334.306833:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027e46aa7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+10:7448:x1876180578866688:12345-0@lo:101: 00010000:00010000:3.0:1789265334.306845:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265334.306876:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ec0690ee/0xbbfdc9019c1d3625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d361e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.306895:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec0690ee/0xbbfdc9019c1d3625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d361e expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.306904:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ec0690ee/0xbbfdc9019c1d3625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d361e expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.306911:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ec0690ee, rc 0) 00000100:00100000:3.0:1789265334.306962:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027e46aa7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+11:7448:x1876180578866688:12345-0@lo:101: Request processed in 120us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.306969:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789265334.307252:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578866688:0@lo:101: 00010000:00010000:1.0:1789265334.307274:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 0000000034a94fbf/0xbbfdc9019c1d361e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.307281:0:7448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 0000000034a94fbf/0xbbfdc9019c1d361e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265334.307293:0:7448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789265334.307311:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 0000000034a94fbf/0xbbfdc9019c1d361e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.307318:0:7448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 0000000034a94fbf/0xbbfdc9019c1d361e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265334.307324:0:7448:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789265334.307329:0:7448:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265334.307333:0:7448:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93774e5c3000 10000000:01000000:1.0:1789265334.307336:0:7448:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789265334.307340:0:7448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789265334.307342:0:7448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789265334.307358:0:7448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 00000000b812cff6/0xbbfdc9019c1d362c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.307364:0:7448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 00000000b812cff6/0xbbfdc9019c1d362c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.307370:0:7448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 00000000b812cff6/0xbbfdc9019c1d362c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265334.307382:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578866816:0@lo:101: 00000100:00100000:1.0:1789265334.307412:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.307452:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 00000000659e6909 going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.307496:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578866816 00000100:00100000:0.0:1789265334.307501:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578866816 00000100:00100000:0.0:1789265334.307537:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265334.307543:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f9e6298 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+11:7448:x1876180578866816:12345-0@lo:101: 00010000:00010000:0.0:1789265334.307552:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265334.307560:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000041a5f3fe/0xbbfdc9019c1d3633 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d362c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.307573:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041a5f3fe/0xbbfdc9019c1d3633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d362c expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.307580:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000041a5f3fe/0xbbfdc9019c1d3633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d362c expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.307597:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000041a5f3fe, rc 0) 00000100:00100000:0.0:1789265334.307639:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f9e6298 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+12:7448:x1876180578866816:12345-0@lo:101: Request processed in 97us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.307645:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789265334.307854:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9db366 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578866816:0@lo:101: 00010000:00010000:3.0:1789265334.307881:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 00000000b812cff6/0xbbfdc9019c1d362c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3633 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.307890:0:7448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 00000000b812cff6/0xbbfdc9019c1d362c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3633 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265334.308019:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0c05a08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578866944:0@lo:501: 00000100:00100000:3.0:1789265334.308044:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.308061:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 00000000256c38b1 going to sleep for 11 seconds 00000100:00100000:2.0:1789265334.308368:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578866944 00000100:00100000:2.0:1789265334.308374:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578866944 00000100:00100000:2.0:1789265334.308400:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265334.308407:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8279f69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+12:7448:x1876180578866944:12345-0@lo:501: 00000100:00100000:2.0:1789265334.308527:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8279f69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+12:7448:x1876180578866944:12345-0@lo:501: Request processed in 120us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.308534:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789265334.308945:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0c05a08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578866944:0@lo:501: 00000100:00100000:3.0:1789265334.308990:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0c05a08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578867072:0@lo:503: 00000100:00100000:3.0:1789265334.309034:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.309069:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 00000000256c38b1 going to sleep for 11 seconds 00000100:00100000:2.0:1789265334.309134:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578867072 00000100:00100000:2.0:1789265334.309139:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578867072 00000100:00100000:2.0:1789265334.309165:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265334.309171:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003811f1c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+12:7448:x1876180578867072:12345-0@lo:503: 00000100:00100000:2.0:1789265334.309265:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003811f1c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+12:7448:x1876180578867072:12345-0@lo:503: Request processed in 93us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.309274:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789265334.309418:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0c05a08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578867072:0@lo:503: 00000040:00080000:3.0:1789265334.309683:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265334.309769:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0c05a08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578867200:0@lo:502: 00000100:00100000:3.0:1789265334.309802:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.310064:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 00000000256c38b1 going to sleep for 11 seconds 00000100:00100000:1.0:1789265334.310218:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578867200 00000100:00100000:1.0:1789265334.310224:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578867200 00000100:00100000:1.0:1789265334.310269:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265334.310278:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041d8f0ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+12:7448:x1876180578867200:12345-0@lo:502: 00000100:00100000:1.0:1789265334.310388:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041d8f0ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+12:7448:x1876180578867200:12345-0@lo:502: Request processed in 111us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265334.310396:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789265334.310948:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0c05a08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578867200:0@lo:502: 00000040:00080000:3.0:1789265334.311233:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789265334.311265:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1789265334.311281:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1789265334.311297:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1789265334.311311:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1789265334.311325:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1789265334.311336:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1789265334.311351:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1789265334.311364:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1789265334.311378:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1789265334.311393:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1789265334.311406:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1789265334.311419:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1789265334.311444:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1789265334.311462:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1789265334.311477:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1789265334.311491:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1789265334.311504:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1789265334.311516:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1789265334.311529:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1789265334.311543:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1789265334.311556:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1789265334.311568:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1789265334.311604:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0c05a08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578867328:0@lo:502: 00000100:00100000:3.0:1789265334.311663:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.311708:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 00000000256c38b1 going to sleep for 11 seconds 00000100:00100000:2.0:1789265334.311783:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578867328 00000100:00100000:2.0:1789265334.311790:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578867328 00000100:00100000:2.0:1789265334.312346:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789265334.312357:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001468ef2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+12:7448:x1876180578867328:12345-0@lo:502: 00000100:00100000:2.0:1789265334.312491:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001468ef2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+12:7448:x1876180578867328:12345-0@lo:502: Request processed in 137us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.312498:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265334.312978:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0c05a08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578867328:0@lo:502: 00000040:00080000:3.0:1789265334.313060:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1789265334.313075:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1789265334.315115:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265334.315133:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265334.315136:0:7461:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789265334.315142:0:7461:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789265334.315146:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265334.315160:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000013cdeac7) 00000020:00000080:1.0:1789265334.315183:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1789265334.315189:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789265334.315284:0:7461:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789265334.315292:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbbfdc9019c1d3641 00000020:00000080:1.0:1789265334.315508:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789265334.315513:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265334.315517:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265334.315518:0:7461:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789265334.315521:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265334.315524:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265334.315525:0:7461:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789265334.315529:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265334.315543:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000a614f2fb) 00000020:00000080:1.0:1789265334.315554:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1789265334.315559:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789265334.315560:0:7461:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789265334.315563:0:7461:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789265334.315568:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789265334.315617:0:7461:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008a59668c from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789265334.315630:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000001be1b818) 00000020:00000080:1.0:1789265334.315637:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1789265334.315716:0:7461:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789265334.315722:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbbfdc9019c1d3656 00000020:00000080:1.0:1789265334.315828:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789265334.315835:0:7461:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789265334.315840:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xbbfdc9019c1d365d 00080000:01000000:1.0:1789265334.315845:0:7461:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789265334.316681:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbbfdc9019c1d3664 00080000:10000000:1.0:1789265334.317624:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1789265334.317752:0:7461:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1789265334.446693:0:7461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1789265334.447032:0:7461:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1789265334.450373:0:7461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789265334.453355:0:7461:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789265334.473041:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789265334.473061:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265334.473068:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265334.473070:0:7461:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789265334.473074:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265334.473080:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265334.473081:0:7461:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789265334.473084:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265334.473089:0:7461:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:00000080:3.0:1789265334.473120:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265334.473144:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000b9be2cff) 00000020:00000080:3.0:1789265334.473170:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789265334.473175:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265334.473254:0:7461:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789265334.473261:0:7461:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789265334.473273:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbbfdc9019c1d3672 00010000:00080000:3.0:1789265334.473308:0:7461:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000aa9c71d9@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1789265334.485441:0:7461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1789265334.494851:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789265334.495130:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789265334.495192:0:7461:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789265334.495214:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbbfdc9019c1d3679 00000100:00080000:2.0:1789265334.495225:0:7461:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265334.495231:0:7461:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000aa9c71d9 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1789265334.495266:0:7461:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fdd7955d x1876180578867456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265334.495292:0:7461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789265334.495453:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0c05a08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578867584:0@lo:400: 00000100:00100000:3.0:1789265334.495530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.495602:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265334.495609:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092df39c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578867712:0@lo:400: 00000100:00100000:3.0:1789265334.495667:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.495700:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578867712 00000100:00100000:3.0:1789265334.495708:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578867712 00000100:00100000:3.0:1789265334.495750:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265334.495758:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cf3b018 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578867712:12345-0@lo:400: 00000100:00100000:3.0:1789265334.495804:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cf3b018 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578867712:12345-0@lo:400: Request processed in 47us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.495811:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789265334.495851:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000092df39c6 x1876180578867712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265334.495879:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092df39c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578867712:0@lo:400: 00000020:01000000:2.0:1789265334.496148:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265334.496154:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265334.496155:0:7461:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789265334.496158:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789265334.496161:0:7461:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789265334.496164:0:7461:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265334.496165:0:7461:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265334.496167:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789265334.496169:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265334.496171:0:7461:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789265334.496173:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265334.496177:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265334.496178:0:7461:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789265334.496182:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789265334.496221:0:7461:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789265334.496234:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265334.496237:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265334.496238:0:7461:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789265334.496241:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265334.496243:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265334.496254:0:7461:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265334.496258:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265334.496259:0:7461:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789265334.496290:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265334.496293:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265334.496295:0:7461:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789265334.496297:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1789265334.496580:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fdd7955d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180578867456:0@lo:38: 00000100:00100000:0.0:1789265334.496645:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.496697:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578867584 00000100:00100000:0.0:1789265334.496702:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578867584 00000100:00100000:0.0:1789265334.496742:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789265334.496749:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bec7488 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+12:3646:x1876180578867584:12345-0@lo:400: 00000100:00100000:0.0:1789265334.496790:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bec7488 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+12:3646:x1876180578867584:12345-0@lo:400: Request processed in 42us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.496797:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789265334.496830:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578867456 00000100:00100000:0.0:1789265334.496834:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578867456 00000100:00100000:0.0:1789265334.496852:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265334.496878:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000681e54de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876180578867456:12345-0@lo:38: 00010000:00080000:0.0:1789265334.496898:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1789265334.496940:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbbfdc9019c1d3680 00000004:00100000:0.0:1789265334.496970:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789265334.496975:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789265334.497242:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0c05a08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578867584:0@lo:400: 00000020:01000000:3.0:1789265334.497596:0:7448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1789265334.497634:0:7448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789265334.497656:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 00000000b812cff6/0xbbfdc9019c1d362c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3633 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.497666:0:7448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 00000000b812cff6/0xbbfdc9019c1d362c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3633 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265334.497674:0:7448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93774e5c3000 from 1 10000000:01000000:3.0:1789265334.497677:0:7448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789265334.497709:0:7448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.497725:0:7448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.497737:0:7448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265334.497758:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092df39c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578867840:0@lo:101: 00000100:00100000:3.0:1789265334.497798:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.497834:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 00000000256c38b1 going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.497979:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578867840 00000100:00100000:0.0:1789265334.497984:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578867840 00000100:00100000:0.0:1789265334.498018:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789265334.498031:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016232831 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+12:7448:x1876180578867840:12345-0@lo:101: 00010000:00010000:0.0:1789265334.498043:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265334.498208:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000076b47c25/0xbbfdc9019c1d368e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3687 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.498232:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000076b47c25/0xbbfdc9019c1d368e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3687 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.498241:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000076b47c25/0xbbfdc9019c1d368e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3687 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.498248:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000076b47c25, rc 0) 00000100:00100000:0.0:1789265334.498287:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016232831 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+13:7448:x1876180578867840:12345-0@lo:101: Request processed in 257us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.498293:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265334.500026:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092df39c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578867840:0@lo:101: 00010000:00010000:3.0:1789265334.500064:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d368e expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.500075:0:7448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d368e expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265334.500650:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092df39c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578867968:0@lo:256: 00000100:00100000:3.0:1789265334.500727:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.500768:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 00000000256c38b1 going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.501336:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578867968 00000100:00100000:0.0:1789265334.501345:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578867968 00000100:00100000:0.0:1789265334.501394:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789265334.501402:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000986b0cb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+13:7448:x1876180578867968:12345-0@lo:256: 20000000:01000000:0.0:1789265334.501423:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789265334.502428:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789265334.502436:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789265334.502749:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000986b0cb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+13:7448:x1876180578867968:12345-0@lo:256: Request processed in 1346us (2020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.502761:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265334.503123:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092df39c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578867968:0@lo:256: 10000000:01000000:3.0:1789265334.503781:0:7448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789265334.503804:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d368e expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.503815:0:7448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d368e expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265334.503835:0:7448:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93774e5c3000 from 1 10000000:01000000:3.0:1789265334.503838:0:7448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265334.503886:0:7448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.503894:0:7448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.503903:0:7448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265334.503922:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092df39c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868096:0@lo:101: 00000100:00100000:3.0:1789265334.503986:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.504027:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 00000000256c38b1 going to sleep for 11 seconds 00000100:00100000:2.0:1789265334.504311:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578868096 00000100:00100000:2.0:1789265334.504319:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578868096 00000100:00100000:2.0:1789265334.504370:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265334.504377:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038e2503c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+13:7448:x1876180578868096:12345-0@lo:101: 00010000:00010000:2.0:1789265334.504390:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265334.504401:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c9042ca5/0xbbfdc9019c1d369c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3695 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.504423:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9042ca5/0xbbfdc9019c1d369c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3695 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.504433:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c9042ca5/0xbbfdc9019c1d369c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3695 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.504441:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c9042ca5, rc 0) 00000100:00100000:2.0:1789265334.504499:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038e2503c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+14:7448:x1876180578868096:12345-0@lo:101: Request processed in 123us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.504506:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789265334.504692:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092df39c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868096:0@lo:101: 00010000:00010000:3.0:1789265334.504706:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d369c expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.504715:0:7448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d369c expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265334.504805:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092df39c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868224:0@lo:501: 00000100:00100000:3.0:1789265334.504832:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.504885:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 00000000256c38b1 going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.505179:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578868224 00000100:00100000:0.0:1789265334.505183:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578868224 00000100:00100000:0.0:1789265334.505217:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789265334.505223:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b5535e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+14:7448:x1876180578868224:12345-0@lo:501: 00000100:00100000:0.0:1789265334.505337:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b5535e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+14:7448:x1876180578868224:12345-0@lo:501: Request processed in 114us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.505345:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789265334.505455:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092df39c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868224:0@lo:501: 00000100:00100000:1.0:1789265334.505485:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a10d15da pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868352:0@lo:503: 00000100:00100000:1.0:1789265334.505654:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.505680:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a47898d going to sleep for 11 seconds 00000100:00100000:2.0:1789265334.506883:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578868352 00000100:00100000:2.0:1789265334.506893:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578868352 00000100:00100000:2.0:1789265334.506933:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265334.506941:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033a5f289 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+14:7448:x1876180578868352:12345-0@lo:503: 00000040:00080000:2.0:1789265334.507002:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265334.507085:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033a5f289 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+14:7448:x1876180578868352:12345-0@lo:503: Request processed in 145us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.507092:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265334.507173:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a10d15da pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868352:0@lo:503: 00000040:00080000:3.0:1789265334.507454:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265334.507529:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1789265334.507632:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265334.508789:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1789265334.509487:0:7448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789265334.509527:0:7448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265334.509550:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d369c expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.509572:0:7448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d369c expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265334.509642:0:7448:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789265334.509645:0:7448:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93774e5c3000 10000000:01000000:0.0:1789265334.509649:0:7448:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93774e5c3000 10000000:01000000:0.0:1789265334.509652:0:7448:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265334.509659:0:7448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93774e5c3000 from 1 10000000:01000000:0.0:1789265334.509662:0:7448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265334.509705:0:7448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 00000000258a6bd6/0xbbfdc9019c1d36a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.509713:0:7448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 00000000258a6bd6/0xbbfdc9019c1d36a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.509722:0:7448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 00000000258a6bd6/0xbbfdc9019c1d36a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.509747:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff45b7e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868480:0@lo:101: 00000100:00100000:0.0:1789265334.509818:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.509880:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ed7264a going to sleep for 11 seconds 00000100:00100000:3.0:1789265334.510350:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578868480 00000100:00100000:3.0:1789265334.510358:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578868480 00000100:00100000:3.0:1789265334.510399:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789265334.510408:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2b2e543 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+14:7448:x1876180578868480:12345-0@lo:101: 00010000:00010000:3.0:1789265334.510420:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265334.510433:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d7ed082/0xbbfdc9019c1d36aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d36a3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.510457:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d7ed082/0xbbfdc9019c1d36aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36a3 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.510466:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d7ed082/0xbbfdc9019c1d36aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36a3 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.510475:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d7ed082, rc 0) 00000100:00100000:3.0:1789265334.510530:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2b2e543 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:7448:x1876180578868480:12345-0@lo:101: Request processed in 124us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.510536:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265334.510744:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff45b7e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868480:0@lo:101: 00010000:00010000:0.0:1789265334.510759:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 00000000258a6bd6/0xbbfdc9019c1d36a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36aa expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.510768:0:7448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 00000000258a6bd6/0xbbfdc9019c1d36a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d36aa expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.510899:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff45b7e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868608:0@lo:501: 00000100:00100000:0.0:1789265334.510929:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.511198:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ed7264a going to sleep for 11 seconds 00000100:00100000:3.0:1789265334.511319:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578868608 00000100:00100000:3.0:1789265334.511324:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578868608 00000100:00100000:3.0:1789265334.511348:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789265334.511354:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012614337 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:7448:x1876180578868608:12345-0@lo:501: 00000100:00100000:3.0:1789265334.511451:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012614337 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:7448:x1876180578868608:12345-0@lo:501: Request processed in 96us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.511458:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789265334.512202:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff45b7e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868608:0@lo:501: 00000100:00100000:0.0:1789265334.512243:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff45b7e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868736:0@lo:503: 00000100:00100000:0.0:1789265334.512297:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.512334:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ed7264a going to sleep for 11 seconds 00000100:00100000:1.0:1789265334.512402:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578868736 00000100:00100000:1.0:1789265334.512408:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578868736 00000100:00100000:1.0:1789265334.512451:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789265334.512458:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fba8b50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:7448:x1876180578868736:12345-0@lo:503: 00000100:00100000:1.0:1789265334.512581:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fba8b50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:7448:x1876180578868736:12345-0@lo:503: Request processed in 124us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265334.512589:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789265334.512833:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff45b7e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868736:0@lo:503: 00000040:00080000:0.0:1789265334.513462:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265334.513687:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff45b7e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868864:0@lo:502: 00000100:00100000:0.0:1789265334.513743:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.513785:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ed7264a going to sleep for 11 seconds 00000100:00100000:3.0:1789265334.513856:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578868864 00000100:00100000:3.0:1789265334.513887:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578868864 00000100:00100000:3.0:1789265334.513930:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789265334.513938:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f2b1a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:7448:x1876180578868864:12345-0@lo:502: 00000100:00100000:3.0:1789265334.514073:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f2b1a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:7448:x1876180578868864:12345-0@lo:502: Request processed in 136us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.514080:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789265334.514401:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff45b7e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868864:0@lo:502: 00000040:00080000:0.0:1789265334.514771:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789265334.514800:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789265334.514814:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789265334.514828:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789265334.514840:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789265334.514852:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789265334.514903:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789265334.514926:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789265334.514937:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789265334.517539:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789265334.517569:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789265334.517586:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789265334.517599:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789265334.517612:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789265334.517625:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789265334.517642:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789265334.517686:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789265334.517702:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789265334.517717:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789265334.517731:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789265334.517745:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789265334.517759:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789265334.517774:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789265334.517800:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789265334.517816:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789265334.517832:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789265334.517846:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789265334.517882:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1789265334.517935:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff45b7e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868992:0@lo:502: 00000100:00100000:0.0:1789265334.518046:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.518614:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ed7264a going to sleep for 11 seconds 00000100:00100000:3.0:1789265334.518740:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578868992 00000100:00100000:3.0:1789265334.518747:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578868992 00000100:00100000:3.0:1789265334.518801:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789265334.518810:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023ec2af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:7448:x1876180578868992:12345-0@lo:502: 00000100:00100000:3.0:1789265334.518980:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023ec2af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:7448:x1876180578868992:12345-0@lo:502: Request processed in 171us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.518987:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265334.519091:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff45b7e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578868992:0@lo:502: 00000040:00080000:1.0:1789265334.519159:0:7448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789265334.519168:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000100:00080000:3.0:1789265334.520730:0:6524:0:(import.c:65:import_set_state_nolock()) 00000000b512a7cd : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265334.520828:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000681e54de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876180578867456:12345-0@lo:38: Request processed in 23969us (24182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.520841:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265334.521292:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265334.521303:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789265334.521312:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789265334.521317:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789265334.521320:0:3642:0:(import.c:65:import_set_state_nolock()) 00000000aa9c71d9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789265334.521340:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fdd7955d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180578867456:0@lo:38: 00000020:01000004:2.0:1789265334.521760:0:7467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789265334.521774:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000040003a19) 00000020:00000080:2.0:1789265334.521793:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789265334.521931:0:7467:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008a59668c from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789265334.521936:0:7467:0:(tgt_mount.c:187:server_put_mount()) put mount 000000008a59668c from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789265334.522181:0:7467:0:(obd_mount.c:710:lustre_put_lsi()) put 000000008a59668c 3 00010000:00080000:2.0:1789265334.522215:0:7467:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ee36963f@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.142@tcp at head 00000100:00100000:1.0:1789265334.522891:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d1e6d77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578869120:0@lo:41: 00000100:00100000:1.0:1789265334.523226:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.523655:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578869120 00000100:00100000:3.0:1789265334.523665:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578869120 00000100:00100000:3.0:1789265334.523713:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265334.523721:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000112c7640 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876180578869120:12345-0@lo:41: 00000004:00000024:3.0:1789265334.523758:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789265334.523820:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000112c7640 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876180578869120:12345-0@lo:41: Request processed in 100us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.523827:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265334.524552:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d1e6d77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578869120:0@lo:41: 00010000:00010000:3.0:1789265334.528749:0:7467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1789265334.529010:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789265334.529059:0:7467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789265334.529076:0:7467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xbbfdc9019c1d36b8 00000100:00080000:3.0:1789265334.529087:0:7467:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265334.529092:0:7467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000ee36963f using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265334.529131:0:7467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000551cc80b x1876180578869248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265334.529153:0:7467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789265334.531182:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000551cc80b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180578869248:0@lo:38: 00000100:00100000:1.0:1789265334.531264:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.532244:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578869248 00000100:00100000:3.0:1789265334.532256:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578869248 00000100:00100000:3.0:1789265334.532297:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265334.532304:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031a76167 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180578869248:12345-0@lo:38: 00010000:00080000:3.0:1789265334.532333:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:3.0:1789265334.532371:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xbbfdc9019c1d36bf 00000004:00100000:3.0:1789265334.532385:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789265334.532413:0:6520:0:(import.c:65:import_set_state_nolock()) 00000000fd415cc1 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265334.532471:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031a76167 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180578869248:12345-0@lo:38: Request processed in 167us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.532479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789265334.532596:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000551cc80b x1876180578869248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265334.532607:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265334.532616:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789265334.532623:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789265334.532628:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789265334.532630:0:3642:0:(import.c:65:import_set_state_nolock()) 00000000ee36963f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789265334.532635:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000551cc80b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180578869248:0@lo:38: 00000040:00080000:1.0:1789265334.533674:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1789265334.533721:0:7448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789265334.533752:0:7448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265334.533765:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 00000000258a6bd6/0xbbfdc9019c1d36a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36aa expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.533775:0:7448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 00000000258a6bd6/0xbbfdc9019c1d36a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36aa expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789265334.533840:0:7448:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789265334.533842:0:7448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789265334.533844:0:7448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265334.533845:0:7448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265334.533846:0:7448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265334.533848:0:7448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265334.533849:0:7448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265334.533851:0:7448:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265334.533852:0:7448:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265334.533853:0:7448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265334.533884:0:7448:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265334.533888:0:7448:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1789265334.533890:0:7448:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265334.533891:0:7448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789265334.533892:0:7448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265334.533893:0:7448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265334.533894:0:7448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265334.533895:0:7448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265334.533896:0:7448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265334.533897:0:7448:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265334.533898:0:7448:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265334.533899:0:7448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265334.533899:0:7448:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265334.533919:0:7448:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789265334.533934:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578869376:0@lo:253: 00000100:00100000:1.0:1789265334.534003:0:7448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.534034:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578869376 00000100:00100000:1.0:1789265334.534038:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578869376 40000000:00080000:3.0:1789265334.534344:0:7468:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:1.0:1789265334.534816:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265334.534826:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000741792d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:7448:x1876180578869376:12345-0@lo:253: 20000000:01000000:1.0:1789265334.534854:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789265334.534902:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789265334.535747:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a47898d going to sleep for 11 seconds 00000001:00100000:2.0:1789265334.543609:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789265334.543729:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789265334.543751:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789265334.544318:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789265334.544323:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789265334.544341:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.544359:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000448bcc97/0xbbfdc9019c1d35e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d35df expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.544366:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000076b47c25/0xbbfdc9019c1d368e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3687 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.544372:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.544413:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000076b47c25/0xbbfdc9019c1d368e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3687 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.544425:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000076b47c25/0xbbfdc9019c1d368e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3687 expref: 15 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265334.544439:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fdd7955d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876180578869504:0@lo:104: 00000100:00100000:2.0:1789265334.544516:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265334.544573:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000448bcc97/0xbbfdc9019c1d35e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d35df expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.544581:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000448bcc97/0xbbfdc9019c1d35e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d35df expref: 15 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265334.544588:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021b7ab43 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876180578869632:0@lo:104: 00000100:00100000:2.0:1789265334.544606:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265334.544618:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c1df7c1 going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.545686:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578869504 00000100:00100000:0.0:1789265334.545697:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578869504 00000100:00100000:0.0:1789265334.545759:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578869632 00000100:00100000:0.0:1789265334.545762:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578869632 00000100:00100000:0.0:1789265334.545779:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265334.545786:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084942f6c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+4:6535:x1876180578869504:12345-0@lo:104: 00010000:00010000:0.0:1789265334.545799:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d368e expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.545905:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265334.545911:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084942f6c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+4:6535:x1876180578869504:12345-0@lo:104: Request processed in 126us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.545918:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265334.545932:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265334.545938:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032cbfe49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+3:6535:x1876180578869632:12345-0@lo:104: 00010000:00010000:0.0:1789265334.546125:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d35e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.546164:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789265334.546169:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032cbfe49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+3:6535:x1876180578869632:12345-0@lo:104: Request processed in 232us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.546176:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789265334.546197:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265334.546202:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d368e expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.546210:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008eb79e95 already unused, calling callback (000000003dbb8eda) 10000000:00010000:0.0:1789265334.546213:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d368e expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.546221:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d368e expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265334.546227:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d368e expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265334.546232:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265334.546274:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d368e expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.546281:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265334.546300:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d368e expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.546306:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 000000008eb79e95/0xbbfdc9019c1d3687 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d368e expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.546320:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265334.546323:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d35e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.546327:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007f6f7393 already unused, calling callback (000000003dbb8eda) 10000000:00010000:0.0:1789265334.546329:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d35e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.546335:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d35e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265334.546340:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d35e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265334.546344:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265334.546355:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d35e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.546360:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265334.546364:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d35e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.546377:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 000000007f6f7393/0xbbfdc9019c1d35df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d35e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.546393:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265334.546394:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265334.546396:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265334.546403:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265334.546418:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000730c1f76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578869760:0@lo:103: 00000100:00100000:0.0:1789265334.546453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.546490:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265334.546495:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd3ac2fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578869888:0@lo:103: 00000100:00100000:1.0:1789265334.546685:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fdd7955d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876180578869504:0@lo:104: 00000100:00100000:1.0:1789265334.546695:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021b7ab43 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876180578869632:0@lo:104: 00010000:00010000:1.0:1789265334.546719:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265334.547228:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000741792d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:7448:x1876180578869376:12345-0@lo:253: Request processed in 12403us (13224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.547240:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265334.547346:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:7448:1876180578869376:0@lo:253: 10000000:01000000:1.0:1789265334.547356:0:7448:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789265334.547365:0:7448:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265334.547368:0:7448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789265334.547369:0:7448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265334.547370:0:7448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265334.547371:0:7448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265334.547373:0:7448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265334.547374:0:7448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265334.547376:0:7448:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265334.547377:0:7448:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265334.547379:0:7448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265334.547380:0:7448:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789265334.547397:0:7448:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789265334.548272:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.548331:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578869760 00000100:00100000:0.0:1789265334.548338:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578869760 00010000:00010000:0.0:1789265334.548367:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000076b47c25/0xbbfdc9019c1d368e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3687 expref: 15 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.548396:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578869888 00000100:00100000:0.0:1789265334.548399:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578869888 00010000:00010000:0.0:1789265334.548409:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000448bcc97/0xbbfdc9019c1d35e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d35df expref: 16 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.548430:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265334.548438:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcf239ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+16:3645:x1876180578869760:12345-0@lo:103: 00010000:00010000:0.0:1789265334.548451:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265334.548456:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000076b47c25/0xbbfdc9019c1d368e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3687 expref: 16 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.548481:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000076b47c25/0xbbfdc9019c1d368e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3687 expref: 16 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.548509:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000076b47c25/0xbbfdc9019c1d368e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3687 expref: 16 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.548525:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265334.549069:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265334.549081:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033b32500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+15:3645:x1876180578869888:12345-0@lo:103: 00010000:00010000:2.0:1789265334.549090:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265334.549095:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000448bcc97/0xbbfdc9019c1d35e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d35df expref: 15 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.549103:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000448bcc97/0xbbfdc9019c1d35e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d35df expref: 15 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.549121:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000448bcc97/0xbbfdc9019c1d35e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d35df expref: 15 pid: 6513 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.549132:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.549140:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265334.549154:0:7460:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008310862s 00010000:00010000:2.0:1789265334.549158:0:7460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.549164:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.549170:0:7460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.549175:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.549180:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000008b718da already unused, calling callback (00000000f2b4c23c) 00010000:00010000:2.0:1789265334.549183:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.549190:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.549210:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265334.549229:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265334.549260:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033b32500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+14:3645:x1876180578869888:12345-0@lo:103: Request processed in 184us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.549267:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265334.550139:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcf239ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+13:3645:x1876180578869760:12345-0@lo:103: Request processed in 122us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.550148:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265334.550243:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd3ac2fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578869888:0@lo:103: 00000100:00100000:0.0:1789265334.550253:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000730c1f76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578869760:0@lo:103: 00010000:00010000:0.0:1789265334.551442:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.551457:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.551463:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000008b718da/0xbbfdc9019c1d36c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1789265334.562477:0:7448:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1789265334.562721:0:7448:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789265334.563938:0:7448:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789265334.565226:0:7448:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789265334.565494:0:7448:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789265334.566305:0:7448:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789265334.571777:0:7448:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789265334.572168:0:7448:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789265334.572372:0:7448:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1789265334.573038:0:7448:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1789265334.573265:0:7448:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1789265334.573451:0:7448:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1789265334.581304:0:7448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1789265334.581727:0:7473:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1789265334.581786:0:7473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000730c1f76 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7473:1876180578870016:0@lo:700: 00000100:00100000:0.0:1789265334.581887:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.581935:0:7473:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a08ce2a going to sleep for 11 seconds 00000040:01000000:1.0:1789265334.582074:0:7448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789265334.582275:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578870016 00000100:00100000:2.0:1789265334.582283:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578870016 00000100:00100000:2.0:1789265334.582333:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265334.582342:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd3ac2fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7473:x1876180578870016:12345-0@lo:700: 00000100:00100000:2.0:1789265334.582846:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876180578870144:0@lo:1000: 00000100:00100000:2.0:1789265334.582915:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265334.582942:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d42a7dbc going to sleep for 11 seconds 00000040:01000000:1.0:1789265334.583412:0:7448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789265334.583525:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265334.584087:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578870144 00000100:00100000:0.0:1789265334.584104:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578870144 00000100:00100000:0.0:1789265334.584150:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265334.584158:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010b23154 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876180578870144:12345-0@lo:1000: 00000100:00100000:0.0:1789265334.584259:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010b23154 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876180578870144:12345-0@lo:1000: Request processed in 102us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.584267:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00000080:1.0:1789265334.584408:0:7448:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789265334.584417:0:7448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:2.0:1789265334.584678:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876180578870144:0@lo:1000: 00000040:01000000:2.0:1789265334.584712:0:7474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1789265334.584743:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876180578870272:0@lo:700: 00000100:00100000:2.0:1789265334.584791:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265334.584823:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 000000007935b223 going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.584897:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578870272 00000100:00100000:0.0:1789265334.584903:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578870272 00000100:00100000:0.0:1789265334.584933:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265334.584940:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c5b3934 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7474:x1876180578870272:12345-0@lo:700: 00000100:00100000:0.0:1789265334.584998:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c5b3934 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7474:x1876180578870272:12345-0@lo:700: Request processed in 58us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.585004:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265334.585137:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876180578870272:0@lo:700: 00000100:00100000:2.0:1789265334.585178:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7474:1876180578870400:0@lo:900: 00000100:00100000:2.0:1789265334.585206:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265334.585231:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 000000007935b223 going to sleep for 11 seconds 00000040:00080000:1.0:1789265334.585720:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265334.586055:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578870400 00000100:00100000:0.0:1789265334.586061:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578870400 00000100:00100000:0.0:1789265334.586096:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265334.586102:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035dfb89a pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7474:x1876180578870400:12345-0@lo:900: 00000100:00100000:0.0:1789265334.586153:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035dfb89a pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7474:x1876180578870400:12345-0@lo:900: Request processed in 51us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.586159:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789265334.586685:0:7474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c48f5aa6 x1876180578870400/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265334.586697:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7474:1876180578870400:0@lo:900: 00000100:00100000:2.0:1789265334.586783:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876180578870528:0@lo:1000: 00000100:00100000:2.0:1789265334.586825:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265334.586851:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 000000005fc8773f going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.586933:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578870528 00000100:00100000:0.0:1789265334.586938:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578870528 00000100:00100000:0.0:1789265334.587043:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265334.587051:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fad7e111 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876180578870528:12345-0@lo:1000: 00000100:00100000:0.0:1789265334.587115:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fad7e111 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876180578870528:12345-0@lo:1000: Request processed in 64us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.587121:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265334.587184:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876180578870528:0@lo:1000: 00000004:00080000:2.0:1789265334.587227:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000007935b223 with version 0 00000020:00100000:2.0:1789265334.587241:0:7474:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789265334.587246:0:7474:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c48f5aa6 x1876180578870784/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265334.587257:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876180578870784:0@lo:1000: 00000100:00100000:2.0:1789265334.587280:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789265334.587883:0:7448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1789265334.588430:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b202ec9b going to sleep for 11 seconds 00000020:00080000:3.0:1789265334.588681:0:7472:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789265334.588686:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:1.0:1789265334.592005:0:7448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789265334.592112:0:7448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789265334.592358:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789265334.592697:0:7448:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1789265334.593414:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789265334.594016:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789265334.594248:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789265334.594402:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 40000000:02000000:3.0:1789265334.594604:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:0.0:1789265334.596089:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578870784 00000100:00100000:0.0:1789265334.596116:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578870784 00000100:00100000:0.0:1789265334.596178:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265334.596187:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000206aa173 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876180578870784:12345-0@lo:1000: 00100000:10000000:1.0:1789265334.597290:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789265334.598430:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789265334.600289:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789265334.600509:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789265334.600752:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789265334.601053:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789265334.601192:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789265334.601368:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789265334.601510:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000001:00080000:2.0:1789265334.604171:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1789265334.604793:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000206aa173 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876180578870784:12345-0@lo:1000: Request processed in 8605us (17509us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789265334.604807:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1789265334.604886:0:7474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789265334.604892:0:7474:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789265334.604909:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876180578870784:0@lo:1000: 00000100:00100000:2.0:1789265334.605020:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876180578870912:0@lo:1000: 00000100:00100000:2.0:1789265334.605075:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265334.605178:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d42a7dbc going to sleep for 11 seconds 00100000:10000000:1.0:1789265334.605270:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000100:00100000:0.0:1789265334.605272:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578870912 00000100:00100000:0.0:1789265334.605281:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578870912 00000100:00100000:0.0:1789265334.605361:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265334.605371:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d4687b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1876180578870912:12345-0@lo:1000: 00000100:00100000:0.0:1789265334.605446:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d4687b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1876180578870912:12345-0@lo:1000: Request processed in 77us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.605453:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00100000:10000000:1.0:1789265334.605472:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000100:00100000:2.0:1789265334.605567:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876180578870912:0@lo:1000: 00000040:00080000:2.0:1789265334.605585:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789265334.605611:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000007935b223 with version 1 00000004:00080000:2.0:1789265334.605628:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000098bb87be version 1 rpc_version 1 00000020:00100000:2.0:1789265334.605642:0:7464:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789265334.605649:0:7464:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c48f5aa6 x1876180578871168/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265334.605664:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1876180578871168:0@lo:1000: 00000100:00100000:2.0:1789265334.605846:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265334.605887:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b202ec9b going to sleep for 11 seconds 00000100:00100000:2.0:1789265334.605906:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578871168 00000100:00100000:2.0:1789265334.605910:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578871168 00000100:00100000:2.0:1789265334.605931:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265334.605936:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4fcf911 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7464:x1876180578871168:12345-0@lo:1000: 00100000:10000000:1.0:1789265334.606647:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789265334.607037:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789265334.607201:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789265334.607336:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789265334.607490:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789265334.607612:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789265334.607782:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789265334.609077:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789265334.609379:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00000040:00080000:2.0:1789265334.609488:0:7474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789265334.609662:0:7474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:1.0:1789265334.609664:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789265334.609844:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789265334.610176:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789265334.610358:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789265334.610656:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789265334.611070:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789265334.611210:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789265334.611376:0:7448:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789265334.613130:0:7448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789265334.615114:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd3ac2fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7473:x1876180578870016:12345-0@lo:700: Request processed in 32766us (33250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265334.615129:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789265334.615255:0:7473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000730c1f76 x1876180578870016/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789265350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265334.615272:0:7473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000730c1f76 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7473:1876180578870016:0@lo:700: 40000000:02000000:0.0:1789265334.615285:0:7473:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:2.0:1789265334.619482:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1789265334.621124:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4fcf911 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7464:x1876180578871168:12345-0@lo:1000: Request processed in 15178us (15269us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789265334.621139:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1789265334.621361:0:7464:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789265334.621369:0:7464:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789265334.621391:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1876180578871168:0@lo:1000: 00000001:00080000:0.0:1789265334.624091:0:7448:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789265334.624134:0:7448:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa6058198f988 00100000:10000000:0.0:1789265334.624144:0:7448:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789265334.624534:0:7448:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789265334.624567:0:7448:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789265334.624589:0:7448:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789265334.624612:0:7448:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789265334.625467:0:7448:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265334.625670:0:7448:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1789265334.648007:0:7473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265334.660814:0:7473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789265334.660979:0:7473:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789265334.660992:0:7473:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 10000000:01000000:3.0:1789265334.735246:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789265334.735255:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93774e5c3000 from 4 10000000:01000000:3.0:1789265334.735259:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789265334.735311:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 0000000055c128ff/0xbbfdc9019c1d36cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.735323:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 0000000055c128ff/0xbbfdc9019c1d36cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.735335:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 0000000055c128ff/0xbbfdc9019c1d36cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265334.735363:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000432b66dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578871296:0@lo:101: 00000100:00100000:3.0:1789265334.735440:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.736122:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a688da88 going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.738613:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578871296 00000100:00100000:0.0:1789265334.738626:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578871296 00000100:00100000:0.0:1789265334.738692:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789265334.738701:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e452a508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+13:6516:x1876180578871296:12345-0@lo:101: 00010000:00010000:0.0:1789265334.738719:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265334.738740:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c9dd771/0xbbfdc9019c1d36d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d36cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.738770:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c9dd771/0xbbfdc9019c1d36d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36cd expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.738781:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c9dd771/0xbbfdc9019c1d36d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36cd expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.738790:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c9dd771, rc 0) 00000100:00100000:0.0:1789265334.739976:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e452a508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+14:6516:x1876180578871296:12345-0@lo:101: Request processed in 1269us (4529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.739988:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789265334.742600:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000432b66dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578871296:0@lo:101: 00010000:00010000:0.0:1789265334.742633:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 0000000055c128ff/0xbbfdc9019c1d36cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.742647:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 0000000055c128ff/0xbbfdc9019c1d36cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d36d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.742729:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000730c1f76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578871424:0@lo:256: 00000100:00100000:0.0:1789265334.742800:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.742852:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0c9c462 going to sleep for 11 seconds 00000100:00100000:3.0:1789265334.743002:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578871424 00000100:00100000:3.0:1789265334.743010:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578871424 00000100:00100000:3.0:1789265334.743066:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265334.743075:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b7f7fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+14:6516:x1876180578871424:12345-0@lo:256: 20000000:01000000:3.0:1789265334.743099:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789265334.743117:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789265334.743120:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789265334.743205:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b7f7fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+14:6516:x1876180578871424:12345-0@lo:256: Request processed in 130us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.743213:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265334.743287:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000730c1f76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578871424:0@lo:256: 10000000:01000000:0.0:1789265334.743330:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265334.743341:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 0000000055c128ff/0xbbfdc9019c1d36cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.743350:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 0000000055c128ff/0xbbfdc9019c1d36cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265334.743360:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789265334.743363:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff937779e62800 from 21 10000000:01000000:0.0:1789265334.743366:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265334.743388:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000008337c974/0xbbfdc9019c1d36db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.743396:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000008337c974/0xbbfdc9019c1d36db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.743406:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000008337c974/0xbbfdc9019c1d36db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.743419:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000730c1f76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578871552:0@lo:101: 00000100:00100000:0.0:1789265334.743443:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.745061:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0c9c462 going to sleep for 11 seconds 00000100:00100000:3.0:1789265334.748638:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578871552 00000100:00100000:3.0:1789265334.748659:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578871552 00000100:00100000:3.0:1789265334.748720:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789265334.748728:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030f2538d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+14:6516:x1876180578871552:12345-0@lo:101: 00010000:00010000:3.0:1789265334.748754:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265334.748772:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a9aa07e6/0xbbfdc9019c1d36e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d36db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.748801:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a9aa07e6/0xbbfdc9019c1d36e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36db expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.748812:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a9aa07e6/0xbbfdc9019c1d36e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36db expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265334.748821:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a9aa07e6, rc 0) 00000100:00100000:3.0:1789265334.748909:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030f2538d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:6516:x1876180578871552:12345-0@lo:101: Request processed in 181us (5465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.748916:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789265334.750341:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000730c1f76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578871552:0@lo:101: 00010000:00010000:0.0:1789265334.750368:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000008337c974/0xbbfdc9019c1d36db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.750380:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000008337c974/0xbbfdc9019c1d36db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d36e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.750463:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000730c1f76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578871680:0@lo:501: 00000100:00100000:0.0:1789265334.750540:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.750579:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0c9c462 going to sleep for 11 seconds 00000100:00100000:3.0:1789265334.750706:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578871680 00000100:00100000:3.0:1789265334.750714:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578871680 00000100:00100000:3.0:1789265334.750758:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789265334.750765:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b59c3e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:6516:x1876180578871680:12345-0@lo:501: 00000100:00100000:3.0:1789265334.750918:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b59c3e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:6516:x1876180578871680:12345-0@lo:501: Request processed in 154us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.750929:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265334.750995:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000730c1f76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578871680:0@lo:501: 00000100:00100000:0.0:1789265334.751024:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000730c1f76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578871808:0@lo:503: 00000100:00100000:0.0:1789265334.751065:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.751082:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0c9c462 going to sleep for 11 seconds 00000100:00100000:3.0:1789265334.751141:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578871808 00000100:00100000:3.0:1789265334.751146:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578871808 00000100:00100000:3.0:1789265334.751170:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789265334.751178:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abe8a888 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:6516:x1876180578871808:12345-0@lo:503: 00000100:00100000:3.0:1789265334.751265:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abe8a888 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:6516:x1876180578871808:12345-0@lo:503: Request processed in 87us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.751273:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789265334.751337:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000730c1f76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578871808:0@lo:503: 00000100:00100000:1.0:1789265334.754766:0:7484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:7484:1876180578871936:0@lo:502: 00000100:00100000:1.0:1789265334.754851:0:7484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.754959:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578871936 00000100:00100000:1.0:1789265334.754966:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578871936 00000100:00100000:1.0:1789265334.755181:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789265334.755192:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000693c2d3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:7484:x1876180578871936:12345-0@lo:502: 00000100:00100000:1.0:1789265334.755349:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000693c2d3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:7484:x1876180578871936:12345-0@lo:502: Request processed in 158us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265334.755357:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789265334.755425:0:7484:0:(client.c:2715:ptlrpc_set_wait()) set 00000000447b8ef0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265334.755452:0:7484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:7484:1876180578871936:0@lo:502: 00000100:00100000:1.0:1789265334.755519:0:7484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:7484:1876180578872064:0@lo:502: 00000100:00100000:1.0:1789265334.755553:0:7484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.755578:0:7484:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d228c657 going to sleep for 11 seconds 00000100:00100000:1.0:1789265334.756536:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578872064 00000100:00100000:1.0:1789265334.756543:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578872064 00000100:00100000:1.0:1789265334.756575:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789265334.756581:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000190adc90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:7484:x1876180578872064:12345-0@lo:502: 00000100:00100000:1.0:1789265334.756677:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000190adc90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:7484:x1876180578872064:12345-0@lo:502: Request processed in 96us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265334.756685:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789265334.756734:0:7484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:7484:1876180578872064:0@lo:502: 00000040:00080000:1.0:1789265334.756761:0:7484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789265334.756820:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789265334.756848:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265334.756871:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000008337c974/0xbbfdc9019c1d36db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.756882:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000008337c974/0xbbfdc9019c1d36db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265334.756893:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789265334.756896:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff937779e62800 from 4 10000000:01000000:1.0:1789265334.756899:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265334.756925:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000005c075262/0xbbfdc9019c1d36e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.756933:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000005c075262/0xbbfdc9019c1d36e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.757171:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000005c075262/0xbbfdc9019c1d36e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265334.757189:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578872192:0@lo:101: 00000100:00100000:1.0:1789265334.757296:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.757324:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578872192 00000100:00100000:1.0:1789265334.757328:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578872192 00000100:00100000:1.0:1789265334.757355:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265334.757362:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d952e183 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:6516:x1876180578872192:12345-0@lo:101: 00010000:00010000:1.0:1789265334.757371:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265334.757384:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006eea1e0a/0xbbfdc9019c1d36f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d36e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.757407:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006eea1e0a/0xbbfdc9019c1d36f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36e9 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.757424:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006eea1e0a/0xbbfdc9019c1d36f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36e9 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.757435:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006eea1e0a, rc 0) 00000100:00100000:1.0:1789265334.757460:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d952e183 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578872192:12345-0@lo:101: Request processed in 100us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265334.757467:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265334.757663:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d228c657 going to sleep for 11 seconds 00000100:00100000:1.0:1789265334.757677:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578872192:0@lo:101: 00010000:00010000:1.0:1789265334.757688:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000005c075262/0xbbfdc9019c1d36e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36f0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.757697:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000005c075262/0xbbfdc9019c1d36e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d36f0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265334.757744:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578872320:0@lo:256: 00000100:00100000:1.0:1789265334.757776:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.757798:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578872320 00000100:00100000:1.0:1789265334.757802:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578872320 00000100:00100000:1.0:1789265334.757824:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789265334.757830:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020f68ebc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578872320:12345-0@lo:256: 20000000:01000000:1.0:1789265334.757843:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789265334.757877:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789265334.757881:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789265334.758068:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020f68ebc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578872320:12345-0@lo:256: Request processed in 111us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265334.758075:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789265334.758100:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d228c657 going to sleep for 11 seconds 00000100:00100000:1.0:1789265334.758111:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578872320:0@lo:256: 10000000:01000000:1.0:1789265334.758145:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265334.758150:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000005c075262/0xbbfdc9019c1d36e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36f0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.758157:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000005c075262/0xbbfdc9019c1d36e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36f0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265334.758164:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789265334.758166:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789265334.758168:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265334.758181:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000007a17df5a/0xbbfdc9019c1d36f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.758188:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000007a17df5a/0xbbfdc9019c1d36f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.758194:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000007a17df5a/0xbbfdc9019c1d36f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265334.758206:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578872448:0@lo:101: 00000100:00100000:1.0:1789265334.758308:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.758331:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578872448 00000100:00100000:1.0:1789265334.758334:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578872448 00000100:00100000:1.0:1789265334.758357:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789265334.758362:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003051ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578872448:12345-0@lo:101: 00010000:00010000:1.0:1789265334.758369:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265334.758378:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f4a11549/0xbbfdc9019c1d36fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d36f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.758397:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f4a11549/0xbbfdc9019c1d36fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36f7 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.758405:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f4a11549/0xbbfdc9019c1d36fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36f7 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.758412:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f4a11549, rc 0) 00000100:00100000:1.0:1789265334.758436:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003051ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578872448:12345-0@lo:101: Request processed in 74us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265334.758442:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789265334.758464:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d228c657 going to sleep for 11 seconds 00000100:00100000:1.0:1789265334.758552:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578872448:0@lo:101: 00010000:00010000:1.0:1789265334.758562:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000007a17df5a/0xbbfdc9019c1d36f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.758569:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000007a17df5a/0xbbfdc9019c1d36f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d36fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265334.758617:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578872576:0@lo:501: 00000100:00100000:1.0:1789265334.758640:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.758658:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578872576 00000100:00100000:1.0:1789265334.758662:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578872576 00000100:00100000:1.0:1789265334.758680:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789265334.758684:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000782d3e58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578872576:12345-0@lo:501: 00000100:00100000:1.0:1789265334.758783:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000782d3e58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578872576:12345-0@lo:501: Request processed in 98us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265334.758790:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789265334.758816:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d228c657 going to sleep for 11 seconds 00000100:00100000:1.0:1789265334.758828:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578872576:0@lo:501: 00000100:00100000:1.0:1789265334.758852:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578872704:0@lo:503: 00000100:00100000:1.0:1789265334.758904:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.758921:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578872704 00000100:00100000:1.0:1789265334.758924:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578872704 00000100:00100000:1.0:1789265334.759079:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789265334.759086:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042bbe6f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578872704:12345-0@lo:503: 00000100:00100000:1.0:1789265334.759156:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042bbe6f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578872704:12345-0@lo:503: Request processed in 70us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265334.759162:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789265334.759192:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d228c657 going to sleep for 11 seconds 00000100:00100000:1.0:1789265334.759204:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578872704:0@lo:503: 00000100:00100000:2.0:1789265334.764323:0:7485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:7485:1876180578872832:0@lo:502: 00000100:00100000:2.0:1789265334.764426:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265334.764514:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578872832 00000100:00100000:1.0:1789265334.764524:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578872832 00000100:00100000:1.0:1789265334.767787:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789265334.767806:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031bcefcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:7485:x1876180578872832:12345-0@lo:502: 00000100:00100000:1.0:1789265334.768011:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031bcefcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:7485:x1876180578872832:12345-0@lo:502: Request processed in 212us (3586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265334.768019:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265334.774114:0:7485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000da586237 going to sleep for 11 seconds 00000100:00100000:2.0:1789265334.774172:0:7485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c48f5aa6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:7485:1876180578872832:0@lo:502: 00000020:01000000:2.0:1789265334.774229:0:7485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265334.774244:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265334.774247:0:7485:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789265334.774252:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789265334.774255:0:7485:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:00000080:2.0:1789265334.774285:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265334.774315:0:7485:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000609b2825) 00000020:00000080:2.0:1789265334.774343:0:7485:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1789265334.774350:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789265334.774524:0:7485:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789265334.774533:0:7485:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789265334.774542:0:7485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d370c 00010000:00080000:2.0:1789265334.774574:0:7485:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009030656a@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1789265334.783331:0:7485:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1789265334.789941:0:7485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789265334.789970:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789265334.790012:0:7485:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789265334.790036:0:7485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbbfdc9019c1d3713 00000100:00080000:0.0:1789265334.790047:0:7485:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265334.790052:0:7485:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000009030656a using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265334.790089:0:7485:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bcf239ce x1876180578872960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265334.790114:0:7485:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1789265334.790164:0:7485:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1789265334.790272:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcf239ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180578872960:0@lo:38: 00000100:00100000:2.0:1789265334.790363:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.790479:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578872960 00000100:00100000:0.0:1789265334.790488:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578872960 00000100:00100000:0.0:1789265334.790532:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265334.790539:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c48f5aa6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876180578872960:12345-0@lo:38: 00010000:00080000:0.0:1789265334.790576:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1789265334.790609:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbbfdc9019c1d371a 00000004:00100000:0.0:1789265334.790624:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789265334.790630:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1789265334.796262:0:7491:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000dfc65c80 x1876180578873088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265334.796282:0:7491:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1b994dd going to sleep for 0 seconds 00000020:01000000:0.0:1789265334.801000:0:7485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265334.801014:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265334.801016:0:7485:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789265334.801029:0:7485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265334.801034:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265334.801035:0:7485:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789265334.801038:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789265334.801040:0:7485:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789265334.801091:0:7485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cc8b02a pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:7485:1876180578873216:0@lo:502: 00000100:00100000:0.0:1789265334.801184:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.801230:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578873216 00000100:00100000:0.0:1789265334.801237:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578873216 00000100:00100000:0.0:1789265334.801284:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789265334.801293:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c88583e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:7485:x1876180578873216:12345-0@lo:502: 00000100:00100000:0.0:1789265334.801414:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c88583e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:7485:x1876180578873216:12345-0@lo:502: Request processed in 122us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.801423:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789265334.803453:0:7485:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ca09e38 going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.803569:0:7485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cc8b02a pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:7485:1876180578873216:0@lo:502: 00000020:01000000:0.0:1789265334.803614:0:7485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265334.803622:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265334.803625:0:7485:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789265334.803630:0:7485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00080000:3.0:1789265334.804526:0:6524:0:(import.c:65:import_set_state_nolock()) 000000008560ee8a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265334.804636:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c48f5aa6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180578872960:12345-0@lo:38: Request processed in 14094us (14272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.804649:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265334.804704:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265334.804713:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789265334.804723:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789265334.804728:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789265334.804730:0:3642:0:(import.c:65:import_set_state_nolock()) 000000009030656a lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789265334.804745:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f1b994dd): req@00000000dfc65c80 x1876180578873088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265334.804761:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcf239ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180578872960:0@lo:38: 00000100:00100000:0.0:1789265334.804882:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000691210d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578873344:0@lo:41: 00000100:00100000:0.0:1789265334.804924:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.805042:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578873344 00000020:01000000:1.0:1789265334.805044:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00100000:0.0:1789265334.805048:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578873344 10000000:01000000:1.0:1789265334.805070:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789265334.805078:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000007a17df5a/0xbbfdc9019c1d36f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.805081:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265334.805089:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cc8b02a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876180578873344:12345-0@lo:41: 00010000:00010000:1.0:1789265334.805090:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000007a17df5a/0xbbfdc9019c1d36f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d36fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265334.805112:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 00000004:00000024:0.0:1789265334.805113:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 10000000:01000000:1.0:1789265334.805114:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93775f68cd28 from 1 10000000:01000000:1.0:1789265334.805117:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789265334.805141:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000003591863d/0xbbfdc9019c1d3721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.805147:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cc8b02a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876180578873344:12345-0@lo:41: Request processed in 60us (224us total) trans 0 rc 0/0 00010000:00010000:1.0:1789265334.805149:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000003591863d/0xbbfdc9019c1d3721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.805158:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000003591863d/0xbbfdc9019c1d3721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.805159:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265334.805172:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578873472:0@lo:101: 00000100:00100000:0.0:1789265334.805187:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000691210d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578873344:0@lo:41: 00000100:00100000:1.0:1789265334.805202:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.805591:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.805618:0:7491:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1b994dd going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.805760:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578873088 00000100:00100000:0.0:1789265334.805765:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578873088 00000100:00100000:0.0:1789265334.805790:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265334.805796:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076477e23 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7491:x1876180578873088:12345-0@lo:1000: 00000100:00100000:1.0:1789265334.805931:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c2fd34c going to sleep for 11 seconds 00000100:00100000:1.0:1789265334.806027:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578873472 00000100:00100000:1.0:1789265334.806033:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578873472 00000100:00100000:1.0:1789265334.806062:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265334.806068:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074e54822 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578873472:12345-0@lo:101: 00010000:00010000:1.0:1789265334.806077:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265334.806091:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001566ff1f/0xbbfdc9019c1d3728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3721 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265334.806117:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001566ff1f/0xbbfdc9019c1d3728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3721 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.806125:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076477e23 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7491:x1876180578873088:12345-0@lo:1000: Request processed in 329us (535us total) trans 0 rc 0/0 00010000:00010000:1.0:1789265334.806129:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001566ff1f/0xbbfdc9019c1d3728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3721 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.806131:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789265334.806153:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001566ff1f, rc 0) 00000100:00100000:2.0:1789265334.806195:0:7491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfc65c80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7491:1876180578873088:0@lo:1000: 00000100:00100000:1.0:1789265334.806205:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074e54822 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578873472:12345-0@lo:101: Request processed in 138us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265334.806210:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000040:01000000:2.0:1789265334.806238:0:7491:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789265334.806274:0:7491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfc65c80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7491:1876180578873600:0@lo:1000: 00000100:00100000:2.0:1789265334.806309:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265334.806323:0:7491:0:(client.c:2715:ptlrpc_set_wait()) set 000000007d50dc87 going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.806371:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004de8143a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578873472:0@lo:101: 00010000:00010000:0.0:1789265334.806386:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000003591863d/0xbbfdc9019c1d3721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3728 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.806396:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000003591863d/0xbbfdc9019c1d3721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3728 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.806461:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a6e1827 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578873728:0@lo:501: 00000100:00100000:0.0:1789265334.806497:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.806509:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ca09e38 going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.806521:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578873600 00000100:00100000:0.0:1789265334.806525:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578873600 00000100:00100000:0.0:1789265334.806559:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265334.806564:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000384bc1b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7491:x1876180578873600:12345-0@lo:1000: 00000100:00100000:0.0:1789265334.806662:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000384bc1b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7491:x1876180578873600:12345-0@lo:1000: Request processed in 98us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.806669:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265334.806701:0:7491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfc65c80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7491:1876180578873600:0@lo:1000: 00000100:00100000:0.0:1789265334.806738:0:7491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e0a1edf pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7491:1876180578873856:0@lo:700: 00000100:00100000:0.0:1789265334.806762:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.806784:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578873856 00000100:00100000:0.0:1789265334.806787:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578873856 00000100:00100000:0.0:1789265334.806811:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265334.806817:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ac71020 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7491:x1876180578873856:12345-0@lo:700: 00000100:00100000:0.0:1789265334.806850:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ac71020 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7491:x1876180578873856:12345-0@lo:700: Request processed in 33us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.806855:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265334.806898:0:7491:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d5a1e08e going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.806911:0:7491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e0a1edf pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7491:1876180578873856:0@lo:700: 00000100:00100000:1.0:1789265334.807057:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578873728 00000100:00100000:1.0:1789265334.807062:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578873728 00000100:00100000:1.0:1789265334.807083:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265334.807087:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000840cbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578873728:12345-0@lo:501: 00000100:00100000:1.0:1789265334.807157:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000840cbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578873728:12345-0@lo:501: Request processed in 69us (660us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265334.807164:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789265334.807204:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a6e1827 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578873728:0@lo:501: 10000000:01000000:0.0:1789265334.807235:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789265334.807241:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000003591863d/0xbbfdc9019c1d3721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3728 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265334.807249:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000003591863d/0xbbfdc9019c1d3721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3728 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265334.807286:0:7491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a6e1827 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7491:1876180578873984:0@lo:1000: 00000100:00100000:0.0:1789265334.807311:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.807329:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578873984 00000100:00100000:0.0:1789265334.807332:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578873984 00000100:00100000:0.0:1789265334.807349:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265334.807353:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e0a1edf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7491:x1876180578873984:12345-0@lo:1000: 00000100:00100000:0.0:1789265334.807404:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e0a1edf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7491:x1876180578873984:12345-0@lo:1000: Request processed in 51us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265334.807410:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265334.807422:0:7491:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7fd7d07 going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.807432:0:7491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a6e1827 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7491:1876180578873984:0@lo:1000: 00000004:00080000:0.0:1789265334.807466:0:7491:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000d5a1e08e with version 0 00000020:00100000:0.0:1789265334.807529:0:7491:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789265334.807535:0:7491:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000a6e1827 x1876180578874240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265334.807547:0:7491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a6e1827 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7491:1876180578874240:0@lo:1000: 00000100:00100000:0.0:1789265334.807568:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.807586:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578874240 00000100:00100000:0.0:1789265334.807589:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578874240 00000100:00100000:0.0:1789265334.807604:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265334.807608:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000287ae7f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7491:x1876180578874240:12345-0@lo:1000: 00000100:00100000:0.0:1789265334.807911:0:7491:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0c9c462 going to sleep for 11 seconds 00000001:00080000:0.0:1789265334.815629:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1789265334.815642:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789265334.815796:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000287ae7f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7491:x1876180578874240:12345-0@lo:1000: Request processed in 8183us (8223us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789265334.815810:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:0.0:1789265334.815909:0:7491:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789265334.815913:0:7491:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789265334.815926:0:7491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a6e1827 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7491:1876180578874240:0@lo:1000: 00000100:00100000:0.0:1789265334.816090:0:7491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a6e1827 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7491:1876180578874368:0@lo:1000: 00000100:00100000:0.0:1789265334.816133:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265334.816160:0:7491:0:(client.c:2715:ptlrpc_set_wait()) set 0000000067f949fb going to sleep for 11 seconds 00000100:00100000:3.0:1789265334.816233:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578874368 00000100:00100000:3.0:1789265334.816240:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578874368 00000100:00100000:3.0:1789265334.816284:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265334.816292:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ed7c4e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7491:x1876180578874368:12345-0@lo:1000: 00000100:00100000:3.0:1789265334.816355:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ed7c4e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7491:x1876180578874368:12345-0@lo:1000: Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265334.816362:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265334.816421:0:7491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a6e1827 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7491:1876180578874368:0@lo:1000: 00000040:00080000:0.0:1789265334.816447:0:7491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789265334.816532:0:7491:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000d5a1e08e with version 1 00000040:00080000:0.0:1789265334.821272:0:7491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789265334.821354:0:7491:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789265334.821359:0:7491:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:3.0:1789265334.826167:0:7489:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000b11d481f version 1 rpc_version 1 00000020:00100000:3.0:1789265334.826220:0:7489:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789265334.826241:0:7489:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000cc71d2d7 x1876180578874624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265334.826266:0:7489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc71d2d7 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7489:1876180578874624:0@lo:1000: 00000100:00100000:3.0:1789265334.826345:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265334.826393:0:7489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b97246f9 going to sleep for 11 seconds 00000100:00100000:0.0:1789265334.826456:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578874624 00000100:00100000:0.0:1789265334.826465:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578874624 00000100:00100000:0.0:1789265334.826529:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265334.826538:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000895e55cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7489:x1876180578874624:12345-0@lo:1000: 00010000:00010000:0.0:1789265334.837352:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789265334.841846:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1789265334.842060:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000895e55cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7489:x1876180578874624:12345-0@lo:1000: Request processed in 15519us (15712us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789265334.842076:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1789265334.842144:0:7489:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789265334.842150:0:7489:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789265334.842169:0:7489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc71d2d7 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7489:1876180578874624:0@lo:1000: 00010000:00010000:0.0:1789265335.859263:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265336.887417:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265337.910941:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265338.940068:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265339.839373:0:7724:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789265339.892158:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a6e1827 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578874752:0@lo:400: 00000100:00100000:0.0:1789265339.892271:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265339.892332:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcf239ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578875264:0@lo:400: 00000100:00100000:0.0:1789265339.892365:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265339.892397:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265339.892404:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac97261d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578875136:0@lo:400: 00000100:00100000:0.0:1789265339.892430:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265339.892464:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095fe8ba2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578874880:0@lo:400: 00000100:00100000:0.0:1789265339.892489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265339.892508:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265339.892515:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc7d10bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578875008:0@lo:400: 00000100:00100000:0.0:1789265339.892542:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265339.892579:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578875264 00000100:00100000:0.0:1789265339.892605:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578875264 00000100:00100000:0.0:1789265339.892655:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578875008 00000100:00100000:0.0:1789265339.892659:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578875008 00000100:00100000:0.0:1789265339.892681:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265339.892689:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000730c1f76 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578875264:12345-0@lo:400: 00000100:00100000:0.0:1789265339.892762:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000730c1f76 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578875264:12345-0@lo:400: Request processed in 74us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265339.892770:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265339.892791:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265339.892797:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbd66121 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578875008:12345-0@lo:400: 00000100:00100000:0.0:1789265339.892830:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbd66121 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578875008:12345-0@lo:400: Request processed in 34us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265339.892836:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265339.892894:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578875136 00000100:00100000:3.0:1789265339.893071:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578874880 00000100:00100000:3.0:1789265339.893076:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578874880 00000100:00100000:3.0:1789265339.893111:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265339.893116:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088e10ccf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578874880:12345-0@lo:400: 00000100:00100000:3.0:1789265339.893155:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088e10ccf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578874880:12345-0@lo:400: Request processed in 38us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265339.893160:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265339.893183:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265339.893192:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc71d2d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578875392:0@lo:41: 00000100:00100000:3.0:1789265339.893220:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265339.893243:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578875392 00000100:00100000:3.0:1789265339.893246:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578875392 00000100:00100000:3.0:1789265339.893266:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265339.893271:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000276e9738 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578875392:12345-0@lo:41: 00000004:00000024:3.0:1789265339.893329:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789265339.893367:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000276e9738 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578875392:12345-0@lo:41: Request processed in 97us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265339.893373:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265339.893419:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc71d2d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578875392:0@lo:41: 00000100:00100000:0.0:1789265339.893490:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578875136 00000100:00100000:0.0:1789265339.893527:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265339.893533:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff45b7e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578875136:12345-0@lo:400: 00000100:00100000:0.0:1789265339.893566:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff45b7e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578875136:12345-0@lo:400: Request processed in 33us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265339.893572:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265339.893599:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc7d10bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578875008:0@lo:400: 00010000:00080000:0.0:1789265339.893615:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000095fe8ba2 x1876180578874880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265339.893627:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095fe8ba2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578874880:0@lo:400: 00010000:00080000:0.0:1789265339.893655:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ac97261d x1876180578875136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265339.893679:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac97261d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578875136:0@lo:400: 00000100:00100000:0.0:1789265339.893690:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcf239ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578875264:0@lo:400: 00000100:00100000:1.0:1789265339.897389:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578874752 00000100:00100000:1.0:1789265339.897414:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578874752 00000100:00100000:1.0:1789265339.897525:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789265339.897536:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009a64622 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:3644:x1876180578874752:12345-0@lo:400: 00000100:00100000:1.0:1789265339.897655:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009a64622 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:3644:x1876180578874752:12345-0@lo:400: Request processed in 123us (5385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265339.897665:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789265339.897843:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265339.897957:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0174189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578875520:0@lo:41: 00000100:00100000:2.0:1789265339.898011:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265339.898054:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578875520 00000100:00100000:2.0:1789265339.898076:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578875520 00000100:00100000:2.0:1789265339.898113:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265339.898119:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021b7ab43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578875520:12345-0@lo:41: 00000004:00000024:2.0:1789265339.898157:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789265339.898206:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021b7ab43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578875520:12345-0@lo:41: Request processed in 86us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265339.898213:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265339.898267:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0174189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578875520:0@lo:41: 00000100:00100000:0.0:1789265339.898413:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a6e1827 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578874752:0@lo:400: 00010000:00010000:0.0:1789265339.955623:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265340.979508:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265341.384587:0:7776:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265341.384824:0:7776:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789265342.010312:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265343.027225:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265344.061149:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265345.014505:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a6e1827 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578875648:0@lo:400: 00000100:00100000:0.0:1789265345.014613:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265345.014673:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc7d10bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578876160:0@lo:400: 00000100:00100000:0.0:1789265345.014720:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265345.014754:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265345.014760:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcf239ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578875776:0@lo:400: 00000100:00100000:0.0:1789265345.014788:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265345.014822:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac97261d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578875904:0@lo:400: 00000100:00100000:0.0:1789265345.014845:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265345.014909:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265345.014915:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095fe8ba2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578876032:0@lo:400: 00000100:00100000:0.0:1789265345.014939:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265345.014977:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578876160 00000100:00100000:0.0:1789265345.014986:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578876160 00000100:00100000:0.0:1789265345.015032:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578875904 00000100:00100000:0.0:1789265345.015034:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578875904 00000100:00100000:0.0:1789265345.015052:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265345.015061:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000472156c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578876160:12345-0@lo:400: 00000100:00100000:0.0:1789265345.015136:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000472156c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578876160:12345-0@lo:400: Request processed in 75us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265345.015144:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265345.015162:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265345.015168:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c74528db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578875904:12345-0@lo:400: 00000100:00100000:0.0:1789265345.015200:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c74528db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578875904:12345-0@lo:400: Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265345.015205:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265345.015221:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578875776 00000100:00100000:0.0:1789265345.015224:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578875776 00000100:00100000:0.0:1789265345.015248:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578876032 00000100:00100000:0.0:1789265345.015250:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578876032 00000100:00100000:0.0:1789265345.015261:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265345.015266:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ece43c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578875776:12345-0@lo:400: 00000100:00100000:0.0:1789265345.015295:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ece43c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578875776:12345-0@lo:400: Request processed in 29us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265345.015300:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265345.015311:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265345.015316:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f351870 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578876032:12345-0@lo:400: 00000100:00100000:0.0:1789265345.015341:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f351870 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578876032:12345-0@lo:400: Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265345.015347:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789265345.015394:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000095fe8ba2 x1876180578876032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265345.015411:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095fe8ba2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578876032:0@lo:400: 00000100:00100000:0.0:1789265345.015423:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac97261d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578875904:0@lo:400: 00010000:00080000:0.0:1789265345.015463:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000bcf239ce x1876180578875776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265345.015471:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcf239ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578875776:0@lo:400: 00000100:00100000:0.0:1789265345.015480:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc7d10bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578876160:0@lo:400: 00000100:00100000:2.0:1789265345.017919:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578875648 00000100:00100000:2.0:1789265345.017948:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578875648 00000100:00100000:2.0:1789265345.018013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789265345.018023:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dcc8822 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+18:3643:x1876180578875648:12345-0@lo:400: 00000100:00100000:2.0:1789265345.018122:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dcc8822 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+18:3643:x1876180578875648:12345-0@lo:400: Request processed in 100us (3509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265345.018130:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789265345.018201:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a6e1827 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578875648:0@lo:400: 00000100:00100000:2.0:1789265345.018225:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265345.018236:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0174189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578876288:0@lo:41: 00000100:00100000:2.0:1789265345.018277:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265345.018320:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578876288 00000100:00100000:2.0:1789265345.018324:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578876288 00000100:00100000:2.0:1789265345.018353:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265345.018360:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdd7955d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578876288:12345-0@lo:41: 00000004:00000024:2.0:1789265345.018393:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789265345.018443:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdd7955d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578876288:12345-0@lo:41: Request processed in 85us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265345.018450:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265345.018484:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0174189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578876288:0@lo:41: 00000100:00100000:2.0:1789265345.019804:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc71d2d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578876416:0@lo:41: 00000100:00100000:2.0:1789265345.019938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265345.020275:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578876416 00000100:00100000:3.0:1789265345.020284:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578876416 00000100:00100000:3.0:1789265345.020333:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265345.020341:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0174189 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578876416:12345-0@lo:41: 00000004:00000024:3.0:1789265345.020383:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789265345.020433:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0174189 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578876416:12345-0@lo:41: Request processed in 92us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265345.020440:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265345.021147:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc71d2d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578876416:0@lo:41: 00010000:00010000:3.0:1789265345.076216:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265345.183667:0:7878:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265345.183968:0:7878:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265346.099152:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789265346.176553:0:7926:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd8bc9410 20000000:00000080:2.0:1789265346.176575:0:7926:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93774f182400 uarg=0000000000000000 20000000:01000000:2.0:1789265346.176625:0:7926:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789265346.176633:0:7926:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789265346.176637:0:7926:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789265346.176710:0:7926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789265346.176721:0:7926:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789265346.179354:0:7926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265346.179617:0:7926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789265346.179650:0:7926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789265346.179669:0:7926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789265346.179685:0:7926:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789265346.179704:0:7926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.179722:0:7926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b76eb863/0xbbfdc9019c1d35ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d35a7 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.179730:0:7926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c9042ca5/0xbbfdc9019c1d369c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3695 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.179747:0:7926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.179789:0:7926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c9042ca5/0xbbfdc9019c1d369c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3695 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.179803:0:7926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c9042ca5/0xbbfdc9019c1d369c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3695 expref: 17 pid: 6514 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265346.179818:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfc65c80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1876180578876544:0@lo:104: 00000100:00100000:2.0:1789265346.180134:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265346.180209:0:7926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b76eb863/0xbbfdc9019c1d35ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d35a7 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265346.180218:0:7926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b76eb863/0xbbfdc9019c1d35ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d35a7 expref: 17 pid: 6514 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265346.180227:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005762403c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1876180578876672:0@lo:104: 00000100:00100000:2.0:1789265346.180250:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f546185d going to sleep for 11 seconds 00000100:00100000:0.0:1789265346.180319:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789265346.180338:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265346.180370:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578876544 00000100:00100000:0.0:1789265346.180377:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578876544 00000100:00100000:0.0:1789265346.180410:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578876672 00000100:00100000:0.0:1789265346.180413:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578876672 00000100:00100000:0.0:1789265346.180425:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265346.180430:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ceaf13f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+4:7926:x1876180578876544:12345-0@lo:104: 00010000:00010000:0.0:1789265346.180441:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d369c expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.180505:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265346.180510:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ceaf13f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+4:7926:x1876180578876544:12345-0@lo:104: Request processed in 80us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265346.180516:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265346.180553:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265346.180558:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f37be89e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:7926:x1876180578876672:12345-0@lo:104: 00010000:00010000:0.0:1789265346.180563:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d35ae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.180596:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789265346.180601:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f37be89e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:7926:x1876180578876672:12345-0@lo:104: Request processed in 44us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265346.180612:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1789265346.180629:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265346.180635:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d369c expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.180642:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005057da88 already unused, calling callback (000000003dbb8eda) 10000000:00010000:0.0:1789265346.180645:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d369c expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.180653:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d369c expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265346.180660:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d369c expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265346.180665:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265346.180689:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d369c expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.180695:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265346.180713:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d369c expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.180718:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 000000005057da88/0xbbfdc9019c1d3695 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d369c expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.180729:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265346.180731:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d35ae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.180746:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000854a2940 already unused, calling callback (000000003dbb8eda) 10000000:00010000:0.0:1789265346.180748:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d35ae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.180753:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d35ae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265346.180758:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d35ae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265346.180763:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265346.180772:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d35ae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.180777:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265346.180788:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d35ae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.180793:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 00000000854a2940/0xbbfdc9019c1d35a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d35ae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.180813:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265346.180814:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265346.180816:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265346.180832:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be475b0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578876800:0@lo:103: 00000100:00100000:0.0:1789265346.180894:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265346.180925:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051a00567 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578876928:0@lo:103: 00000100:00100000:0.0:1789265346.180948:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265346.180987:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578876800 00000100:00100000:0.0:1789265346.180991:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578876800 00010000:00010000:0.0:1789265346.181007:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c9042ca5/0xbbfdc9019c1d369c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3695 expref: 18 pid: 6514 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265346.181027:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578876928 00000100:00100000:0.0:1789265346.181030:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578876928 00010000:00010000:0.0:1789265346.181040:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b76eb863/0xbbfdc9019c1d35ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d35a7 expref: 19 pid: 6514 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265346.181057:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265346.181063:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bac4632 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+19:3646:x1876180578876800:12345-0@lo:103: 00010000:00010000:0.0:1789265346.181072:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265346.181076:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c9042ca5/0xbbfdc9019c1d369c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3695 expref: 19 pid: 6514 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.181084:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c9042ca5/0xbbfdc9019c1d369c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3695 expref: 19 pid: 6514 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.181098:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265346.181124:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bac4632 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+19:3646:x1876180578876800:12345-0@lo:103: Request processed in 61us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265346.181130:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265346.181142:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265346.181147:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009550be50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+18:3643:x1876180578876928:12345-0@lo:103: 00010000:00010000:0.0:1789265346.181154:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265346.181157:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b76eb863/0xbbfdc9019c1d35ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d35a7 expref: 18 pid: 6514 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.181164:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b76eb863/0xbbfdc9019c1d35ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d35a7 expref: 18 pid: 6514 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.181178:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.181183:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.181191:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.181195:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.181198:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.181201:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.181204:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004d03a453 already unused, calling callback (00000000f2b4c23c) 00010000:00010000:0.0:1789265346.181206:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.181210:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.181214:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265346.181219:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265346.181236:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009550be50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+18:3643:x1876180578876928:12345-0@lo:103: Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265346.181246:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265346.181274:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051a00567 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578876928:0@lo:103: 00000100:00100000:0.0:1789265346.181289:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be475b0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578876800:0@lo:103: 00010000:00010000:3.0:1789265346.181423:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265346.181466:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c9042ca5/0xbbfdc9019c1d369c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3695 expref: 17 pid: 6514 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265346.181477:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfc65c80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1876180578876544:0@lo:104: 00010000:00010000:3.0:1789265346.181486:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b76eb863/0xbbfdc9019c1d35ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d35a7 expref: 16 pid: 6514 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265346.181493:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005762403c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1876180578876672:0@lo:104: 00010000:00010000:3.0:1789265346.181510:0:7926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.181518:0:7926:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.181534:0:7926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265346.181540:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004d03a453/0xbbfdc9019c1d372f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265347.126483:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265348.150777:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265349.171168:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265350.131202:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051a00567 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578877184:0@lo:400: 00000100:00100000:0.0:1789265350.131299:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265350.131357:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265350.131363:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aa21c877 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578877312:0@lo:400: 00000100:00100000:0.0:1789265350.131390:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265350.131436:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578877184 00000100:00100000:0.0:1789265350.131444:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578877184 00000100:00100000:0.0:1789265350.131492:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265350.131502:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f84dba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578877184:12345-0@lo:400: 00000100:00100000:0.0:1789265350.131556:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f84dba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578877184:12345-0@lo:400: Request processed in 56us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265350.131577:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789265350.131620:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000051a00567 x1876180578877184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265350.131646:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051a00567 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578877184:0@lo:400: 00000100:00100000:1.0:1789265350.132397:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be475b0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578877056:0@lo:400: 00000100:00100000:1.0:1789265350.132449:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265350.132492:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000725e7f6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578877568:0@lo:400: 00000100:00100000:1.0:1789265350.132521:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265350.132541:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265350.132548:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aa6dd632 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578877440:0@lo:400: 00000100:00100000:1.0:1789265350.132571:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265350.132617:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578877440 00000100:00100000:0.0:1789265350.132735:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578877056 00000100:00100000:0.0:1789265350.132751:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578877056 00000100:00100000:0.0:1789265350.132789:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789265350.132815:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddc154e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:3644:x1876180578877056:12345-0@lo:400: 00000100:00100000:0.0:1789265350.133072:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddc154e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:3644:x1876180578877056:12345-0@lo:400: Request processed in 276us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265350.133090:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789265350.133173:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578877440 00000100:00100000:1.0:1789265350.133216:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265350.133371:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578877312 00000100:00100000:2.0:1789265350.133376:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578877312 00000100:00100000:2.0:1789265350.133399:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578877568 00000100:00100000:2.0:1789265350.133402:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578877568 00000100:00100000:2.0:1789265350.133416:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265350.133422:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b1d0d45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578877312:12345-0@lo:400: 00000100:00100000:2.0:1789265350.133470:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b1d0d45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578877312:12345-0@lo:400: Request processed in 48us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265350.133483:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265350.133497:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265350.133502:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002af76ed7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578877568:12345-0@lo:400: 00000100:00100000:2.0:1789265350.133530:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002af76ed7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578877568:12345-0@lo:400: Request processed in 28us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265350.133536:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265350.133602:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000268d8b9b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578877824:0@lo:41: 00000100:00100000:1.0:1789265350.133708:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df7a0fb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578877440:12345-0@lo:400: 00000100:00100000:3.0:1789265350.136696:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047fd4520 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578877696:0@lo:41: 00000100:00100000:1.0:1789265350.140452:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df7a0fb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578877440:12345-0@lo:400: Request processed in 7222us (7873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265350.140470:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265350.141184:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265350.141354:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578877824 00000100:00100000:1.0:1789265350.141363:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578877824 00000100:00100000:1.0:1789265350.141416:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265350.141424:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009049d1b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578877824:12345-0@lo:41: 00000004:00000024:1.0:1789265350.141460:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789265350.141510:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009049d1b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578877824:12345-0@lo:41: Request processed in 87us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265350.141517:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265350.144207:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000268d8b9b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578877824:0@lo:41: 00000100:00100000:2.0:1789265350.144957:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265350.145179:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aa21c877 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578877312:0@lo:400: 00000100:00100000:2.0:1789265350.145215:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578877696 00000100:00100000:2.0:1789265350.145220:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578877696 00000100:00100000:2.0:1789265350.145257:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265350.145264:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000268d8b9b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578877696:12345-0@lo:41: 00000004:00000024:2.0:1789265350.145298:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1789265350.145344:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000268d8b9b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578877696:12345-0@lo:41: Request processed in 79us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265350.145351:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265350.145387:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047fd4520 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578877696:0@lo:41: 00000100:00100000:0.0:1789265350.145480:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be475b0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578877056:0@lo:400: 00000100:00100000:0.0:1789265350.145497:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000725e7f6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578877568:0@lo:400: 00010000:00080000:0.0:1789265350.145525:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000aa6dd632 x1876180578877440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265350.145537:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aa6dd632 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578877440:0@lo:400: 00010000:00010000:3.0:1789265350.195218:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265351.223450:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265352.252421:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265353.266978:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265354.299341:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265355.254984:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a27c8ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578877952:0@lo:400: 00000100:00100000:2.0:1789265355.255069:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265355.255131:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265355.255138:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b2fbbcb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578878080:0@lo:400: 00000100:00100000:2.0:1789265355.255177:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265355.267959:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ed15af3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578878208:0@lo:400: 00000100:00100000:2.0:1789265355.268040:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265355.268081:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265355.268087:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000121d59ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578878336:0@lo:41: 00000100:00100000:2.0:1789265355.268103:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265355.268144:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578878208 00000100:00100000:0.0:1789265355.268152:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578878208 00000100:00100000:2.0:1789265355.268171:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578877952 00000100:00100000:2.0:1789265355.268174:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578877952 00000100:00100000:2.0:1789265355.268206:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265355.268214:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc1747ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+16:3643:x1876180578877952:12345-0@lo:400: 00000100:00100000:2.0:1789265355.268258:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc1747ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+16:3643:x1876180578877952:12345-0@lo:400: Request processed in 46us (13190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265355.268262:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578878336 00000100:00100000:0.0:1789265355.268265:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578878336 00000100:00100000:2.0:1789265355.268266:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789265355.268279:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789265355.268284:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b2c27d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876180578878208:12345-0@lo:400: 00000100:00100000:2.0:1789265355.268299:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578878080 00000100:00100000:2.0:1789265355.268303:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578878080 00000100:00100000:0.0:1789265355.268324:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b2c27d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876180578878208:12345-0@lo:400: Request processed in 40us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265355.268327:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265355.268330:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265355.268332:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047fd4520 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578878080:12345-0@lo:400: 00000100:00100000:2.0:1789265355.268361:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047fd4520 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578878080:12345-0@lo:400: Request processed in 30us (13184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265355.268367:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265355.268418:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265355.268425:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f949e93 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578878336:12345-0@lo:41: 00000004:00000024:0.0:1789265355.268447:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789265355.268477:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f949e93 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578878336:12345-0@lo:41: Request processed in 54us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265355.268483:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265355.268711:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265355.268738:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009473ccc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578878464:0@lo:41: 00000100:00100000:3.0:1789265355.268817:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265355.269396:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578878464 00000100:00100000:3.0:1789265355.269406:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578878464 00000100:00100000:3.0:1789265355.269448:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265355.269457:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004ff19d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578878464:12345-0@lo:41: 00000004:00000024:3.0:1789265355.273550:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789265355.273697:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004ff19d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578878464:12345-0@lo:41: Request processed in 4235us (4874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265355.273711:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265355.273822:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009473ccc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578878464:0@lo:41: 00010000:00080000:2.0:1789265355.274078:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006b2fbbcb x1876180578878080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265355.274098:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b2fbbcb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578878080:0@lo:400: 00000100:00100000:2.0:1789265355.274109:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a27c8ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578877952:0@lo:400: 00000100:00100000:2.0:1789265355.274171:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000121d59ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578878336:0@lo:41: 00000100:00100000:2.0:1789265355.274202:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ed15af3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578878208:0@lo:400: 00000100:00100000:2.0:1789265355.274407:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265355.274421:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ed15af3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578878592:0@lo:400: 00000100:00100000:2.0:1789265355.274492:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265355.274539:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578878592 00000100:00100000:0.0:1789265355.274549:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578878592 00000100:00100000:0.0:1789265355.274607:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265355.274616:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000121d59ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578878592:12345-0@lo:400: 00000100:00100000:0.0:1789265355.274683:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000121d59ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578878592:12345-0@lo:400: Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265355.276092:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789265355.276123:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001ed15af3 x1876180578878592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265355.276137:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ed15af3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578878592:0@lo:400: 00010000:00010000:1.0:1789265355.314973:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789265355.762945:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265355.762951:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93774e5c3000 from 1 10000000:01000000:0.0:1789265355.762956:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265355.762999:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000003b72b804/0xbbfdc9019c1d3736 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265355.763013:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000003b72b804/0xbbfdc9019c1d3736 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265355.763023:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000003b72b804/0xbbfdc9019c1d3736 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265355.763049:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aa6dd632 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578878720:0@lo:101: 00000100:00100000:0.0:1789265355.763124:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265355.763173:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 000000005c468954 going to sleep for 11 seconds 00000100:00100000:2.0:1789265355.763687:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578878720 00000100:00100000:2.0:1789265355.763695:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578878720 00000100:00100000:2.0:1789265355.765185:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789265355.765204:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4a2a7ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578878720:12345-0@lo:101: 00010000:00010000:2.0:1789265355.765221:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265355.765237:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fcafb728/0xbbfdc9019c1d373d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3736 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265355.765265:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fcafb728/0xbbfdc9019c1d373d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3736 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265355.765274:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fcafb728/0xbbfdc9019c1d373d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3736 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265355.765283:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fcafb728, rc 0) 00000100:00100000:2.0:1789265355.765349:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4a2a7ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578878720:12345-0@lo:101: Request processed in 155us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265355.765355:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789265355.765960:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aa6dd632 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578878720:0@lo:101: 00010000:00010000:0.0:1789265355.765980:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000003b72b804/0xbbfdc9019c1d3736 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d373d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265355.765990:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000003b72b804/0xbbfdc9019c1d3736 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d373d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265355.766074:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aa6dd632 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578878848:0@lo:501: 00000100:00100000:0.0:1789265355.766106:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265355.775162:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 000000005c468954 going to sleep for 11 seconds 00000100:00100000:3.0:1789265355.775437:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578878848 00000100:00100000:3.0:1789265355.775447:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578878848 00000100:00100000:3.0:1789265355.776214:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789265355.776225:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d6c1036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578878848:12345-0@lo:501: 00000100:00100000:3.0:1789265355.776405:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d6c1036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578878848:12345-0@lo:501: Request processed in 182us (10298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265355.776421:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789265355.776479:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aa6dd632 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578878848:0@lo:501: 00000100:00100000:3.0:1789265355.778946:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a27c8ca pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578878976:0@lo:503: 00000100:00100000:3.0:1789265355.779028:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265355.789874:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 000000007209942f going to sleep for 11 seconds 00000100:00100000:2.0:1789265355.791615:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578878976 00000100:00100000:2.0:1789265355.791628:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578878976 00000100:00100000:2.0:1789265355.793139:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789265355.793150:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9780aed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578878976:12345-0@lo:503: 00000100:00100000:2.0:1789265355.793317:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9780aed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578878976:12345-0@lo:503: Request processed in 168us (14288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265355.793325:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789265355.799914:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a27c8ca pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578878976:0@lo:503: 00000100:00100000:2.0:1789265355.801146:0:8250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009365b8de pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8250:1876180578879104:0@lo:502: 00000100:00100000:2.0:1789265355.801232:0:8250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265355.801281:0:8250:0:(client.c:2715:ptlrpc_set_wait()) set 000000000892248d going to sleep for 11 seconds 00000100:00100000:3.0:1789265355.802406:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578879104 00000100:00100000:3.0:1789265355.802418:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578879104 00000100:00100000:3.0:1789265355.802474:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789265355.802482:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edc29473 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:8250:x1876180578879104:12345-0@lo:502: 00000100:00100000:3.0:1789265355.804006:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edc29473 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:8250:x1876180578879104:12345-0@lo:502: Request processed in 1517us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265355.804020:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789265355.804094:0:8250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009365b8de pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8250:1876180578879104:0@lo:502: 00000020:01000000:3.0:1789265355.804134:0:8250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265355.804144:0:8250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265355.804147:0:8250:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789265355.804154:0:8250:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93774e5c3000 00000020:00000080:3.0:1789265355.804157:0:8250:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789265355.804215:0:8250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8250:1876180578879232:0@lo:502: 00000100:00100000:3.0:1789265355.804265:0:8250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265355.804297:0:8250:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e787540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265355.804312:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578879232 00000100:00100000:3.0:1789265355.804318:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578879232 00000100:00100000:3.0:1789265355.804346:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789265355.804354:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:8250:x1876180578879232:12345-0@lo:502: 00000100:00100000:3.0:1789265355.804429:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:8250:x1876180578879232:12345-0@lo:502: Request processed in 76us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265355.804440:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789265355.804472:0:8250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8250:1876180578879232:0@lo:502: 00000020:01000000:3.0:1789265355.804488:0:8250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265355.804492:0:8250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265355.804494:0:8250:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789265355.804497:0:8250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789265355.804565:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789265355.804603:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265355.804614:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937740031c00/0xbbfdc9019c1d3736 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d373d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265355.804624:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937740031c00/0xbbfdc9019c1d3736 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d373d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265355.804634:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789265355.804637:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff937779e62800 from 1 10000000:01000000:3.0:1789265355.804640:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265355.804663:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265355.804671:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265355.804680:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265355.804693:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578879360:0@lo:101: 00000100:00100000:3.0:1789265355.804719:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265355.804733:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e787540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265355.804831:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578879360 00000100:00100000:3.0:1789265355.804835:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578879360 00000100:00100000:3.0:1789265355.804852:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789265355.804880:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578879360:12345-0@lo:101: 00010000:00010000:3.0:1789265355.804888:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265355.804900:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377413fcc00/0xbbfdc9019c1d374b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3744 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265355.804920:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377413fcc00/0xbbfdc9019c1d374b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3744 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265355.804930:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377413fcc00/0xbbfdc9019c1d374b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3744 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265355.804939:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fcc00, rc 0) 00000100:00100000:3.0:1789265355.804967:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578879360:12345-0@lo:101: Request processed in 109us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265355.804973:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789265355.804995:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578879360:0@lo:101: 00010000:00010000:3.0:1789265355.805006:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d374b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265355.805015:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d374b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265355.805061:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578879488:0@lo:501: 00000100:00100000:3.0:1789265355.805085:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265355.805094:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e787540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265355.805108:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578879488 00000100:00100000:3.0:1789265355.805117:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578879488 00000100:00100000:3.0:1789265355.805134:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789265355.805140:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578879488:12345-0@lo:501: 00000100:00100000:3.0:1789265355.805229:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578879488:12345-0@lo:501: Request processed in 88us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265355.805236:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789265355.805258:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578879488:0@lo:501: 00000100:00100000:3.0:1789265355.805283:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578879616:0@lo:503: 00000100:00100000:3.0:1789265355.805316:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265355.805325:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e787540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265355.805340:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578879616 00000100:00100000:3.0:1789265355.805343:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578879616 00000100:00100000:3.0:1789265355.805359:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789265355.805365:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578879616:12345-0@lo:503: 00000100:00100000:3.0:1789265355.805443:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578879616:12345-0@lo:503: Request processed in 78us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265355.805449:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789265355.805476:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578879616:0@lo:503: 00000100:00100000:2.0:1789265355.807015:0:8252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8252:1876180578879744:0@lo:502: 00000100:00100000:2.0:1789265355.807083:0:8252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265355.807123:0:8252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377612d43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265355.807199:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578879744 00000100:00100000:1.0:1789265355.807206:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578879744 00000100:00100000:1.0:1789265355.807243:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789265355.807254:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:8252:x1876180578879744:12345-0@lo:502: 00000100:00100000:1.0:1789265355.807368:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:8252:x1876180578879744:12345-0@lo:502: Request processed in 116us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265355.807375:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789265355.807475:0:8252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8252:1876180578879744:0@lo:502: 00000020:01000000:2.0:1789265355.807502:0:8252:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265355.807510:0:8252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265355.807512:0:8252:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789265355.807519:0:8252:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff937779e62800 00000020:00000080:2.0:1789265355.807522:0:8252:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789265355.807542:0:8252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8252:1876180578879872:0@lo:502: 00000100:00100000:2.0:1789265355.807584:0:8252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265355.807602:0:8252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377612d43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265355.807712:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578879872 00000100:00100000:1.0:1789265355.807717:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578879872 00000100:00100000:1.0:1789265355.807764:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789265355.807771:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:8252:x1876180578879872:12345-0@lo:502: 00000100:00100000:1.0:1789265355.807837:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:8252:x1876180578879872:12345-0@lo:502: Request processed in 66us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265355.807843:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789265355.808246:0:8252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8252:1876180578879872:0@lo:502: 00000020:01000000:2.0:1789265355.808268:0:8252:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265355.808272:0:8252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265355.808274:0:8252:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789265355.808277:0:8252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789265355.808828:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789265355.808854:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265355.808892:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d374b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265355.808904:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d374b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265356.342514:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265357.363969:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265358.387241:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789265359.325467:0:8427:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789265359.325472:0:8427:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789265359.325473:0:8427:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789265359.325628:0:8427:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93777aaec000 00000020:01000004:3.0:1789265359.325644:0:8427:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789265359.325658:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789265359.325671:0:8427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93777a984d28) 00000020:00000080:3.0:1789265359.325687:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1789265359.411807:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789265359.413987:0:8427:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789265359.414179:0:8427:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1789265359.454774:0:8427:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789265359.455044:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789265359.455057:0:8427:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789265359.455070:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbbfdc9019c1d3759 00000020:01000004:3.0:1789265359.455076:0:8427:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789265359.455099:0:8427:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789265359.455103:0:8427:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789265359.455110:0:8427:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789265359.455115:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789265359.455126:0:8427:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93777a9819b8) 00000020:00000080:3.0:1789265359.455139:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1789265359.456655:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265359.456917:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789265359.456923:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789265359.462184:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789265359.462199:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789265359.478218:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789265359.478237:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789265359.503964:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265359.504179:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789265359.504186:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789265359.506084:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789265359.506097:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789265359.568484:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265359.572095:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789265359.572110:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789265359.580555:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789265359.580569:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789265359.585689:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789265359.585706:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789265359.587973:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265359.588221:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789265359.588228:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789265359.597691:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789265359.598218:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789265359.660207:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265359.660448:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789265359.660454:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789265359.667908:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789265359.667925:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789265359.669570:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789265359.669614:0:8427:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789265359.669620:0:8427:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789265359.703326:0:8427:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789265359.703373:0:8427:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.142@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789265359.703377:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789265359.703379:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789265359.703380:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265359.703381:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265359.703383:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265359.703384:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265359.703386:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265359.703387:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265359.703388:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265359.703390:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265359.703391:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265359.703395:0:8427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789265359.703397:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265359.703398:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789265359.703399:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265359.703400:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265359.703401:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265359.703402:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265359.703403:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265359.703404:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265359.703405:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265359.703405:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265359.703407:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265359.703432:0:8427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789265359.703453:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578880000:0@lo:253: 00000100:00100000:0.0:1789265359.703528:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265359.703672:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578880000 00000100:00100000:1.0:1789265359.703682:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578880000 00000100:00100000:1.0:1789265359.704345:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789265359.704357:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:8427:x1876180578880000:12345-0@lo:253: 20000000:01000000:1.0:1789265359.704387:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789265359.704391:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789265359.704395:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789265359.704398:0:6512:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789265359.704877:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265359.705035:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789265359.705050:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000100:00100000:3.0:1789265359.705284:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebfe40 going to sleep for 11 seconds 00000040:00080000:3.0:1789265359.712384:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789265359.712417:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789265359.712498:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789265359.712520:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789265359.712666:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789265359.712686:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.142@tcp 20000000:01000000:3.0:1789265359.712699:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:3.0:1789265359.712729:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789265359.712738:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789265359.712783:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789265359.712791:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:3.0:1789265359.712805:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789265359.712832:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789265359.712849:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789265359.712907:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789265359.712983:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789265359.712994:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.142@tcp 20000000:01000000:3.0:1789265359.712996:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:3.0:1789265359.713009:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789265359.713015:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789265359.713028:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789265359.713032:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:3.0:1789265359.713044:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789265359.713050:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789265359.713063:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789265359.713098:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789265359.713467:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789265359.713480:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.142@tcp 20000000:01000000:3.0:1789265359.713482:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:3.0:1789265359.713496:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789265359.713502:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789265359.713513:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789265359.713517:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:3.0:1789265359.713529:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789265359.713534:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789265359.713547:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789265359.713563:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789265359.713579:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789265359.713582:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789265359.713587:0:6512:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789265359.713658:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789265359.713661:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789265359.722816:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1789265359.722935:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1789265359.722955:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789265359.723332:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1789265359.723358:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1789265359.723376:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1789265359.723389:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789265359.723392:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789265359.724088:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789265359.724246:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789265359.724266:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789265359.724290:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789265359.724302:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789265359.724304:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789265359.724732:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1789265359.724759:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1789265359.724776:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789265359.725094:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789265359.725125:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789265359.725140:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789265359.725150:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789265359.725152:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789265359.725575:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1789265359.725598:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1789265359.725615:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1789265359.725940:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1789265359.725963:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1789265359.725979:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:0.0:1789265359.725999:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789265359.726019:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.726037:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937740031000/0xbbfdc9019c1d3633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d362c expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.726044:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377413fc800/0xbbfdc9019c1d36aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36a3 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.726051:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d36e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36db expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.726057:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d36fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36f7 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.726064:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3721 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.726087:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.726133:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3721 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.726159:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3721 expref: 18 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.726174:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876180578880128:0@lo:104: 00000100:00100000:0.0:1789265359.726246:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265359.726300:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d36fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d36f7 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.726309:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d36fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36f7 expref: 18 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.726317:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876180578880256:0@lo:104: 00000100:00100000:0.0:1789265359.726339:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265359.726366:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d36e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d36db expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.726374:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d36e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36db expref: 18 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.726382:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876180578880384:0@lo:104: 00000100:00100000:0.0:1789265359.726402:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265359.726418:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377413fc800/0xbbfdc9019c1d36aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d36a3 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.726426:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377413fc800/0xbbfdc9019c1d36aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36a3 expref: 18 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.726434:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876180578880512:0@lo:104: 00000100:00100000:0.0:1789265359.726464:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265359.726480:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937740031000/0xbbfdc9019c1d3633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d362c expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.726488:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937740031000/0xbbfdc9019c1d3633 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d362c expref: 18 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.726496:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876180578880640:0@lo:104: 00000100:00100000:0.0:1789265359.726515:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265359.726524:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265359.726739:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578880128 00000100:00100000:3.0:1789265359.726748:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578880128 00000100:00100000:3.0:1789265359.726781:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578880256 00000100:00100000:3.0:1789265359.726784:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578880256 00000100:00100000:3.0:1789265359.726793:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578880384 00000100:00100000:3.0:1789265359.726795:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578880384 00000100:00100000:3.0:1789265359.726803:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578880512 00000100:00100000:3.0:1789265359.726805:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578880512 00000100:00100000:3.0:1789265359.726812:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578880640 00000100:00100000:3.0:1789265359.726814:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578880640 00000100:00100000:3.0:1789265359.726825:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265359.726833:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+7:6512:x1876180578880128:12345-0@lo:104: 00010000:00010000:3.0:1789265359.726845:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3728 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.726929:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265359.726936:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+7:6512:x1876180578880128:12345-0@lo:104: Request processed in 103us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.726943:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265359.726959:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265359.726966:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+6:6512:x1876180578880256:12345-0@lo:104: 00010000:00010000:3.0:1789265359.726974:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d36f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d36fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727004:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789265359.727009:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+6:6512:x1876180578880256:12345-0@lo:104: Request processed in 45us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.727014:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265359.727033:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265359.727039:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+5:6512:x1876180578880384:12345-0@lo:104: 00010000:00010000:3.0:1789265359.727046:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937740030600/0xbbfdc9019c1d36db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d36e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727087:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789265359.727092:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+5:6512:x1876180578880384:12345-0@lo:104: Request processed in 54us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.727098:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265359.727109:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265359.727115:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+4:6512:x1876180578880512:12345-0@lo:104: 00010000:00010000:3.0:1789265359.727121:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d36a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d36aa expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727145:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789265359.727150:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+4:6512:x1876180578880512:12345-0@lo:104: Request processed in 37us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.727155:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265359.727166:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265359.727171:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+3:6512:x1876180578880640:12345-0@lo:104: 00010000:00010000:3.0:1789265359.727178:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d362c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3633 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727219:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789265359.727224:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+3:6512:x1876180578880640:12345-0@lo:104: Request processed in 53us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.727229:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789265359.727252:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789265359.727258:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3728 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727265:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bda00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:3.0:1789265359.727268:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3728 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727276:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3728 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265359.727283:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3728 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265359.727289:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265359.727314:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3728 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727320:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265359.727347:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3721 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3728 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727354:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3728 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727366:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789265359.727369:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d36f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d36fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727375:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd200 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:3.0:1789265359.727378:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d36f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d36fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727392:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d36f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d36fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265359.727398:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d36f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d36fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265359.727403:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265359.727417:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d36f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727422:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265359.727427:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d36f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727434:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d36f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727443:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789265359.727446:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937740030600/0xbbfdc9019c1d36db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d36e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727451:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030600 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:3.0:1789265359.727454:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937740030600/0xbbfdc9019c1d36db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d36e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727460:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937740030600/0xbbfdc9019c1d36db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d36e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265359.727466:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937740030600/0xbbfdc9019c1d36db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d36e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265359.727477:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265359.727491:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937740030600/0xbbfdc9019c1d36db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727496:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265359.727511:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937740030600/0xbbfdc9019c1d36db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727517:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937740030600/0xbbfdc9019c1d36db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727527:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265359.727529:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d36a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d36aa expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727547:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030c00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:3.0:1789265359.727550:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d36a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d36aa expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727556:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d36a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d36aa expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265359.727562:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d36a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d36aa expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265359.727567:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265359.727579:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d36a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36aa expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727585:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265359.727596:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d36a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36aa expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727602:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d36a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36aa expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727611:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265359.727614:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d362c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3633 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727621:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc200 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:3.0:1789265359.727624:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d362c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3633 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727630:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d362c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3633 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265359.727636:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d362c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3633 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265359.727640:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265359.727653:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d362c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3633 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727658:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265359.727662:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d362c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3633 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727667:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d362c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3633 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.727679:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265359.727687:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265359.727688:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265359.727730:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578880768:0@lo:103: 00000100:00100000:3.0:1789265359.727763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.727782:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578881280:0@lo:103: 00000100:00100000:3.0:1789265359.727799:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.727817:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265359.727823:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578880896:0@lo:103: 00000100:00100000:3.0:1789265359.727840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.727888:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578880768 00000100:00100000:3.0:1789265359.727893:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578880768 00010000:00010000:3.0:1789265359.727913:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3728 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3721 expref: 19 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265359.727932:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578881280 00000100:00100000:3.0:1789265359.727934:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578881280 00010000:00010000:3.0:1789265359.727944:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937740031000/0xbbfdc9019c1d3633 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d362c expref: 20 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265359.727955:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578880896 00000100:00100000:3.0:1789265359.727957:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578880896 00010000:00010000:3.0:1789265359.727965:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d36fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36f7 expref: 21 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265359.727977:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265359.727983:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+21:3645:x1876180578880768:12345-0@lo:103: 00010000:00010000:3.0:1789265359.727993:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265359.727998:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3728 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3721 expref: 21 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728019:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3721 expref: 21 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728034:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265359.728062:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+21:3645:x1876180578880768:12345-0@lo:103: Request processed in 80us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.728069:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265359.728083:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265359.728089:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+20:3645:x1876180578881280:12345-0@lo:103: 00010000:00010000:3.0:1789265359.728096:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265359.728101:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937740031000/0xbbfdc9019c1d3633 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d362c expref: 20 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728110:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937740031000/0xbbfdc9019c1d3633 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d362c expref: 20 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728120:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265359.728139:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+20:3645:x1876180578881280:12345-0@lo:103: Request processed in 51us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.728145:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265359.728156:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265359.728162:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+19:3645:x1876180578880896:12345-0@lo:103: 00010000:00010000:3.0:1789265359.728168:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265359.728173:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d36fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36f7 expref: 19 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728181:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d36fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36f7 expref: 19 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728197:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265359.728216:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+19:3645:x1876180578880896:12345-0@lo:103: Request processed in 55us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.728222:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265359.728252:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578880896:0@lo:103: 00000100:00100000:3.0:1789265359.728261:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578880768:0@lo:103: 00000100:00100000:3.0:1789265359.728267:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578881280:0@lo:103: 00000100:00100000:3.0:1789265359.728297:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578881024:0@lo:103: 00000100:00100000:3.0:1789265359.728320:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.728337:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265359.728342:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578881152:0@lo:103: 00000100:00100000:3.0:1789265359.728362:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.728377:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578881024 00000100:00100000:3.0:1789265359.728381:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578881024 00010000:00010000:3.0:1789265359.728393:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d36e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36db expref: 19 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265359.728404:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578881152 00000100:00100000:3.0:1789265359.728406:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578881152 00010000:00010000:3.0:1789265359.728415:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377413fc800/0xbbfdc9019c1d36aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36a3 expref: 20 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265359.728425:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265359.728430:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+20:3643:x1876180578881024:12345-0@lo:103: 00010000:00010000:3.0:1789265359.728436:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265359.728439:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d36e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36db expref: 20 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728454:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d36e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36db expref: 20 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728464:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265359.728492:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+20:3643:x1876180578881024:12345-0@lo:103: Request processed in 61us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.728498:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265359.728510:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265359.728517:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f67c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+19:3643:x1876180578881152:12345-0@lo:103: 00010000:00010000:3.0:1789265359.728524:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265359.728527:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377413fc800/0xbbfdc9019c1d36aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36a3 expref: 19 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728537:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377413fc800/0xbbfdc9019c1d36aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36a3 expref: 19 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728549:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728559:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728574:0:7460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728582:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728589:0:7460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728602:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728609:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030e00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265359.728614:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728623:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728632:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.728641:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265359.728666:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f67c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+19:3643:x1876180578881152:12345-0@lo:103: Request processed in 149us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.728673:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265359.728728:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578881152:0@lo:103: 00000100:00100000:3.0:1789265359.728739:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578881024:0@lo:103: 00010000:00010000:1.0:1789265359.729882:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265359.730303:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3721 expref: 18 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.730320:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876180578880128:0@lo:104: 00010000:00010000:0.0:1789265359.730332:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d36fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d36f7 expref: 17 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.730340:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876180578880256:0@lo:104: 00010000:00010000:0.0:1789265359.730350:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d36e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d36db expref: 16 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.730358:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876180578880384:0@lo:104: 00010000:00010000:0.0:1789265359.730368:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377413fc800/0xbbfdc9019c1d36aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d36a3 expref: 15 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.730379:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876180578880512:0@lo:104: 00010000:00010000:0.0:1789265359.730390:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937740031000/0xbbfdc9019c1d3633 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d362c expref: 14 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.730419:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876180578880640:0@lo:104: 00010000:00010000:0.0:1789265359.730445:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.730454:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.730460:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.730466:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d3767 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789265359.730480:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789265359.752961:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+13:8427:x1876180578880000:12345-0@lo:253: Request processed in 48595us (49422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.752979:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789265359.753131:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578880000:0@lo:253: 10000000:01000000:3.0:1789265359.753148:0:8427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789265359.753152:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265359.753154:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789265359.753155:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265359.753157:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789265359.753158:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265359.753160:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265359.753162:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265359.753164:0:8427:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789265359.753180:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265359.753182:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789265359.753201:0:8427:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93777aaec000 from lustre-OST0000 10000000:01000000:3.0:1789265359.753240:0:8427:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789265359.753244:0:8427:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789265359.753253:0:8427:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93775f68cd28 local copy 10000000:01000000:3.0:1789265359.753257:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789265359.753292:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.753304:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.753313:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265359.753333:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578881408:0@lo:101: 00000100:00100000:3.0:1789265359.753372:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.753418:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265359.753484:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578881408 00000100:00100000:2.0:1789265359.753491:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578881408 00000100:00100000:2.0:1789265359.753546:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789265359.753556:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+13:8427:x1876180578881408:12345-0@lo:101: 00010000:00010000:2.0:1789265359.753569:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265359.753582:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93774167e200/0xbbfdc9019c1d3775 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d376e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265359.753604:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93774167e200/0xbbfdc9019c1d3775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d376e expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265359.753616:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93774167e200/0xbbfdc9019c1d3775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d376e expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265359.753636:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93774167e200, rc 0) 00000100:00100000:2.0:1789265359.753683:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+14:8427:x1876180578881408:12345-0@lo:101: Request processed in 128us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265359.753690:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789265359.753941:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578881408:0@lo:101: 00010000:00010000:0.0:1789265359.753954:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbbfdc9019c1d3775 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.753964:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbbfdc9019c1d3775 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.754057:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578881536:0@lo:501: 00000100:00100000:0.0:1789265359.754087:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265359.754109:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265359.754264:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578881536 00000100:00100000:2.0:1789265359.754269:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578881536 00000100:00100000:2.0:1789265359.754308:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789265359.754316:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+14:8427:x1876180578881536:12345-0@lo:501: 00000100:00100000:2.0:1789265359.754384:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+14:8427:x1876180578881536:12345-0@lo:501: Request processed in 69us (296us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265359.754392:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789265359.754469:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578881536:0@lo:501: 10000000:01000000:0.0:1789265359.754493:0:8427:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789265359.754508:0:8427:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789265359.754514:0:8427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbbfdc9019c1d3775 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.754522:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbbfdc9019c1d3775 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.754529:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbbfdc9019c1d3775 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.754562:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789265359.754587:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93777aaec000 10000000:01000000:0.0:1789265359.754592:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789265359.754597:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789265359.754600:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265359.754604:0:8427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789265359.754607:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789265359.754624:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.754632:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.754641:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.754653:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578881664:0@lo:101: 00000100:00100000:0.0:1789265359.754677:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265359.754697:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265359.754726:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578881664 00000100:00100000:0.0:1789265359.754730:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578881664 00000100:00100000:0.0:1789265359.754754:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789265359.754760:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+14:8427:x1876180578881664:12345-0@lo:101: 00010000:00010000:0.0:1789265359.754767:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265359.754777:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937740031600/0xbbfdc9019c1d3783 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d377c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.754794:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937740031600/0xbbfdc9019c1d3783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d377c expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.754803:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937740031600/0xbbfdc9019c1d3783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d377c expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.754810:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740031600, rc 0) 00000100:00100000:0.0:1789265359.754836:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578881664:12345-0@lo:101: Request processed in 77us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.754843:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789265359.754903:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578881664:0@lo:101: 00010000:00010000:0.0:1789265359.754913:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3783 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.754920:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3783 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.754972:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578881792:0@lo:501: 00000100:00100000:0.0:1789265359.754999:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265359.755019:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265359.755037:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578881792 00000100:00100000:0.0:1789265359.755040:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578881792 00000100:00100000:0.0:1789265359.755059:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789265359.755065:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578881792:12345-0@lo:501: 00000100:00100000:0.0:1789265359.755162:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578881792:12345-0@lo:501: Request processed in 96us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.755168:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789265359.755196:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578881792:0@lo:501: 00000100:00100000:0.0:1789265359.755219:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578881920:0@lo:503: 00000100:00100000:0.0:1789265359.755260:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265359.755273:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265359.755284:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578881920 00000100:00100000:0.0:1789265359.755288:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578881920 00000100:00100000:0.0:1789265359.755307:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789265359.755312:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578881920:12345-0@lo:503: 00000100:00100000:0.0:1789265359.755382:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578881920:12345-0@lo:503: Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.755388:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789265359.755428:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578881920:0@lo:503: 00000040:00080000:0.0:1789265359.755674:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265359.755762:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578882048:0@lo:502: 00000100:00100000:0.0:1789265359.755793:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265359.755809:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265359.755823:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578882048 00000100:00100000:0.0:1789265359.755827:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578882048 00000100:00100000:0.0:1789265359.755850:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789265359.755856:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578882048:12345-0@lo:502: 00000100:00100000:0.0:1789265359.755974:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578882048:12345-0@lo:502: Request processed in 116us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.755980:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789265359.756019:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578882048:0@lo:502: 00000040:00080000:0.0:1789265359.756239:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789265359.756263:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789265359.756278:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789265359.756291:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789265359.756304:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789265359.756318:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789265359.756337:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578882176:0@lo:502: 00000100:00100000:0.0:1789265359.756372:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265359.756397:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265359.756411:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578882176 00000100:00100000:0.0:1789265359.756415:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578882176 00000100:00100000:0.0:1789265359.756438:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789265359.756443:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578882176:12345-0@lo:502: 00000100:00100000:0.0:1789265359.756507:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578882176:12345-0@lo:502: Request processed in 63us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.756514:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789265359.756553:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578882176:0@lo:502: 00000040:00080000:0.0:1789265359.756588:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789265359.756595:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:2.0:1789265359.757291:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265359.757300:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbbfdc9019c1d3775 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265359.757310:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fda00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265359.757313:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbbfdc9019c1d3775 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265359.757323:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbbfdc9019c1d3775 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265359.757331:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbbfdc9019c1d3775 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265359.757337:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265359.757365:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbbfdc9019c1d3775 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265359.757384:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265359.757413:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbbfdc9019c1d3775 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265359.757421:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d376e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbbfdc9019c1d3775 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265359.757435:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265359.757437:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265359.757439:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265359.757446:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265359.757460:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578882304:0@lo:103: 00000100:00100000:2.0:1789265359.757499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265359.757553:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578882304 00000100:00100000:2.0:1789265359.757558:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578882304 00000100:00100000:2.0:1789265359.757596:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265359.757604:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+15:3645:x1876180578882304:12345-0@lo:103: 00010000:00010000:2.0:1789265359.757616:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265359.757632:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93774167e200/0xbbfdc9019c1d3775 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d376e expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265359.757644:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265359.757674:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+14:3645:x1876180578882304:12345-0@lo:103: Request processed in 70us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265359.757681:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265359.757729:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578882304:0@lo:103: 00000020:01000000:1.0:1789265359.758341:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789265359.758350:0:8450:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789265359.758356:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265359.758359:0:8450:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789265359.758365:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265359.758380:0:8450:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9377778c4d28) 00000020:00000080:1.0:1789265359.758404:0:8450:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789265359.758411:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789265359.758499:0:8450:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93777aaec000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789265359.758508:0:8450:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789265359.758515:0:8450:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbbfdc9019c1d3791 00010000:00010000:1.0:1789265359.772528:0:8450:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1789265359.774393:0:8450:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789265359.779704:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789265359.783807:0:8450:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789265359.790294:0:8450:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789265359.790488:0:8450:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1789265359.812005:0:8450:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789265359.814903:0:8450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789265359.814917:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265359.814925:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265359.814927:0:8450:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789265359.814938:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265359.814942:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265359.814944:0:8450:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789265359.814947:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789265359.814949:0:8450:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789265359.814972:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265359.814975:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265359.814976:0:8450:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789265359.814980:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789265359.815204:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789265359.815234:0:8427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789265359.815255:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3783 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.815267:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3783 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265359.815287:0:8427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93777aaec000 from 1 10000000:01000000:3.0:1789265359.815290:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265359.815328:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.815335:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.815345:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265359.815367:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578882432:0@lo:101: 00000100:00100000:3.0:1789265359.815443:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.815496:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265359.815650:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578882432 00000100:00100000:0.0:1789265359.815657:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578882432 00000100:00100000:0.0:1789265359.815703:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789265359.815793:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+14:8427:x1876180578882432:12345-0@lo:101: 00010000:00010000:0.0:1789265359.815808:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265359.815821:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d379f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3798 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.815844:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d379f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3798 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.815855:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d379f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3798 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.815930:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740030e00, rc 0) 00000100:00100000:0.0:1789265359.816904:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578882432:12345-0@lo:101: Request processed in 1112us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.816913:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789265359.824975:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578882432:0@lo:101: 00010000:00010000:3.0:1789265359.825007:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d379f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.825020:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d379f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265359.825148:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578882560:0@lo:501: 00000100:00100000:3.0:1789265359.825208:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.825320:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265359.830685:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578882560 00000100:00100000:2.0:1789265359.830785:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578882560 00000100:00100000:0.0:1789265359.831164:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789265359.831288:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578882560:12345-0@lo:501: 00000100:00100000:1.0:1789265359.831518:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578882560:12345-0@lo:501: Request processed in 343us (6309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265359.831526:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789265359.831700:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578882560:0@lo:501: 00000100:00100000:3.0:1789265359.831833:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578882688:0@lo:503: 00000100:00100000:3.0:1789265359.832577:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.832621:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265359.832835:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578882688 00000100:00100000:0.0:1789265359.832842:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578882688 00000100:00100000:0.0:1789265359.832916:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789265359.832935:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578882688:12345-0@lo:503: 00000100:00100000:0.0:1789265359.833057:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578882688:12345-0@lo:503: Request processed in 124us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.833065:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789265359.833334:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578882688:0@lo:503: 00000040:00080000:3.0:1789265359.833609:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265359.833683:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578882816:0@lo:502: 00000100:00100000:3.0:1789265359.833819:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.833887:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265359.833955:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578882816 00000100:00100000:1.0:1789265359.833960:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578882816 00000100:00100000:1.0:1789265359.833994:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789265359.834001:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578882816:12345-0@lo:502: 00000100:00100000:1.0:1789265359.834110:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578882816:12345-0@lo:502: Request processed in 109us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265359.834117:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789265359.834403:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578882816:0@lo:502: 00000040:00080000:3.0:1789265359.834649:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789265359.834675:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789265359.834697:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578882944:0@lo:502: 00000100:00100000:3.0:1789265359.834818:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.834930:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265359.837843:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578882944 00000100:00100000:2.0:1789265359.838808:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578882944 00000100:00100000:2.0:1789265359.838892:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789265359.838903:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578882944:12345-0@lo:502: 00000100:00100000:2.0:1789265359.839096:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578882944:12345-0@lo:502: Request processed in 195us (4277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265359.839105:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789265359.839131:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578882944:0@lo:502: 00000040:00080000:3.0:1789265359.839216:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789265359.839230:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789265359.840825:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265359.840837:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265359.840840:0:8454:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789265359.840847:0:8454:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93777aaec000 00000020:00000080:1.0:1789265359.840850:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265359.841007:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265359.841012:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265359.841014:0:8454:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789265359.841017:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789265359.841232:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789265359.841258:0:8427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265359.841315:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d379f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.841328:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d379f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265359.841377:0:8427:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789265359.841380:0:8427:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93777aaec000 10000000:01000000:3.0:1789265359.841384:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93777aaec000 10000000:01000000:3.0:1789265359.841395:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265359.841401:0:8427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93777aaec000 from 1 10000000:01000000:3.0:1789265359.841404:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265359.841438:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.841448:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.841459:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265359.841480:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578883072:0@lo:101: 00000100:00100000:3.0:1789265359.841647:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.841745:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265359.841852:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578883072 00000100:00100000:0.0:1789265359.841942:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578883072 00000100:00100000:1.0:1789265359.842055:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789265359.842066:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:8427:x1876180578883072:12345-0@lo:101: 00010000:00010000:1.0:1789265359.842457:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265359.842472:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d37ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d37a6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.842498:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d37ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d37a6 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.842510:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d37ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d37a6 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.842518:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bcc00, rc 0) 00000100:00100000:1.0:1789265359.842732:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:8427:x1876180578883072:12345-0@lo:101: Request processed in 667us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265359.842740:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789265359.843051:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578883072:0@lo:101: 00010000:00010000:3.0:1789265359.843330:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d37ad expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.843342:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d37ad expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265359.843453:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578883200:0@lo:501: 00000100:00100000:3.0:1789265359.843494:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.843522:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265359.843667:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578883200 00000100:00100000:2.0:1789265359.843673:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578883200 00000100:00100000:2.0:1789265359.843732:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789265359.843740:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:8427:x1876180578883200:12345-0@lo:501: 00000100:00100000:2.0:1789265359.843907:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:8427:x1876180578883200:12345-0@lo:501: Request processed in 168us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265359.843915:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789265359.844068:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578883200:0@lo:501: 00000100:00100000:3.0:1789265359.844096:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578883328:0@lo:503: 00000100:00100000:3.0:1789265359.844135:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.844169:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265359.844244:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578883328 00000100:00100000:1.0:1789265359.844255:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578883328 00000100:00100000:1.0:1789265359.844279:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789265359.844285:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+16:8427:x1876180578883328:12345-0@lo:503: 00000100:00100000:1.0:1789265359.844371:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+16:8427:x1876180578883328:12345-0@lo:503: Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265359.844379:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789265359.844451:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578883328:0@lo:503: 00000040:00080000:3.0:1789265359.844684:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265359.844770:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578883456:0@lo:502: 00000100:00100000:3.0:1789265359.844806:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.844831:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265359.845014:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578883456 00000100:00100000:1.0:1789265359.845018:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578883456 00000100:00100000:1.0:1789265359.845038:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789265359.845044:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+16:8427:x1876180578883456:12345-0@lo:502: 00000100:00100000:1.0:1789265359.845126:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+16:8427:x1876180578883456:12345-0@lo:502: Request processed in 81us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265359.845133:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789265359.845209:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578883456:0@lo:502: 00000040:00080000:3.0:1789265359.845374:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789265359.845398:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789265359.845412:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789265359.845424:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789265359.845437:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789265359.845463:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789265359.845478:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789265359.845490:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789265359.845503:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789265359.845516:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789265359.845700:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789265359.845798:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789265359.845812:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789265359.845824:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789265359.845837:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789265359.845851:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789265359.846058:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789265359.846075:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789265359.846090:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789265359.846102:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789265359.846117:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789265359.846143:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789265359.846157:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789265359.846171:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789265359.846191:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789265359.846205:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789265359.846218:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789265359.846230:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789265359.846240:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789265359.846250:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789265359.846261:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789265359.846274:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789265359.846286:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789265359.846300:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789265359.846312:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789265359.846324:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789265359.846336:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1789265359.846378:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578883584:0@lo:502: 00000100:00100000:3.0:1789265359.846432:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.846474:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265359.847785:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578883584 00000100:00100000:1.0:1789265359.847796:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578883584 00000100:00100000:1.0:1789265359.847882:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789265359.847892:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+16:8427:x1876180578883584:12345-0@lo:502: 00000100:00100000:1.0:1789265359.848041:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+16:8427:x1876180578883584:12345-0@lo:502: Request processed in 150us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265359.848048:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265359.848211:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578883584:0@lo:502: 00000040:00080000:3.0:1789265359.848286:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789265359.848299:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789265359.851288:0:8455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789265359.851305:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93774f18b370) 00000020:00000080:2.0:1789265359.851329:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789265359.851402:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93777aaec000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789265359.851406:0:8455:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93777aaec000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789265359.851408:0:8455:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93777aaec000 3 00010000:00080000:2.0:1789265359.851438:0:8455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9376420e2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1789265359.853663:0:8455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1789265359.853951:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789265359.853997:0:8455:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789265359.854010:0:8455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbbfdc9019c1d37bb 00000100:00080000:2.0:1789265359.854022:0:8455:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265359.854029:0:8455:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9376420e2800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1789265359.854069:0:8455:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37f800 x1876180578883712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265359.854093:0:8455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789265359.857921:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180578883712:0@lo:38: 00000100:00100000:3.0:1789265359.858008:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.858249:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578883712 00000100:00100000:3.0:1789265359.858257:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578883712 00000100:00100000:3.0:1789265359.858291:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265359.858299:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876180578883712:12345-0@lo:38: 00010000:00080000:3.0:1789265359.858326:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:3.0:1789265359.858363:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbbfdc9019c1d37c2 00000004:00100000:3.0:1789265359.858379:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789265359.858414:0:6519:0:(import.c:65:import_set_state_nolock()) ffff937641a6b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265359.858474:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180578883712:12345-0@lo:38: Request processed in 175us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.858482:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789265359.858520:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93774f37f800 x1876180578883712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265359.858532:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265359.858539:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789265359.858546:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789265359.858551:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789265359.858553:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376420e2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789265359.858559:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180578883712:0@lo:38: 00000100:00100000:0.0:1789265359.859994:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578883968:0@lo:400: 00000100:00100000:0.0:1789265359.860051:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265359.860083:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265359.860090:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578883840:0@lo:400: 00000100:00100000:0.0:1789265359.860114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265359.860143:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578884096:0@lo:400: 00000100:00100000:0.0:1789265359.860167:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265359.860187:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265359.860192:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578884224:0@lo:400: 00000100:00100000:0.0:1789265359.860214:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265359.860247:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578883968 00000100:00100000:0.0:1789265359.860253:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578883968 00000100:00100000:0.0:1789265359.860282:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578884224 00000100:00100000:0.0:1789265359.860285:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578884224 00000100:00100000:0.0:1789265359.860299:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265359.860308:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578883968:12345-0@lo:400: 00000100:00100000:0.0:1789265359.860354:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578883968:12345-0@lo:400: Request processed in 47us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.860361:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265359.860376:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265359.860381:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578884224:12345-0@lo:400: 00000100:00100000:0.0:1789265359.860421:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578884224:12345-0@lo:400: Request processed in 39us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.860428:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265359.860445:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578883840 00000100:00100000:0.0:1789265359.860448:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578883840 00000100:00100000:0.0:1789265359.860469:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578884096 00000100:00100000:0.0:1789265359.860472:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578884096 00000100:00100000:0.0:1789265359.860483:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265359.860489:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578883840:12345-0@lo:400: 00000100:00100000:0.0:1789265359.860518:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578883840:12345-0@lo:400: Request processed in 29us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.860524:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265359.860535:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265359.860542:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578884096:12345-0@lo:400: 00000100:00100000:0.0:1789265359.860568:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578884096:12345-0@lo:400: Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265359.860574:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265359.860610:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578884224:0@lo:400: 00010000:00080000:0.0:1789265359.860622:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93774e40d880 x1876180578884096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265359.860632:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578884096:0@lo:400: 00010000:00080000:0.0:1789265359.860660:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93774e40e300 x1876180578883840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265359.860671:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578883840:0@lo:400: 00000100:00100000:0.0:1789265359.860680:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578883968:0@lo:400: 00000020:01000004:3.0:1789265359.862114:0:8455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789265359.862132:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93777a980000) 00000020:00000080:3.0:1789265359.862155:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1789265359.862242:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93777aaec000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789265359.862247:0:8455:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93777aaec000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789265359.862249:0:8455:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93777aaec000 3 00010000:00080000:3.0:1789265359.862281:0:8455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff937641a6d000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1789265359.866479:0:8455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1789265359.867078:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789265359.867124:0:8455:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789265359.867139:0:8455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xbbfdc9019c1d37d0 00000100:00080000:3.0:1789265359.867152:0:8455:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265359.867159:0:8455:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff937641a6d000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265359.867195:0:8455:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93775285d180 x1876180578884352/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265359.867224:0:8455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789265359.867279:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180578884352:0@lo:38: 00000100:00100000:2.0:1789265359.867347:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.873992:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578884352 00000100:00100000:3.0:1789265359.874005:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578884352 00000100:00100000:3.0:1789265359.874054:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265359.874063:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180578884352:12345-0@lo:38: 00010000:00080000:3.0:1789265359.874095:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:3.0:1789265359.874132:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xbbfdc9019c1d37d7 00000004:00100000:3.0:1789265359.874149:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789265359.874184:0:6520:0:(import.c:65:import_set_state_nolock()) ffff93774e41e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265359.874271:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180578884352:12345-0@lo:38: Request processed in 208us (6923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265359.874279:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:3.0:1789265359.875061:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789265359.875164:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789265359.875195:0:8427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789265359.875211:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d37ad expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265359.875222:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d37ad expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789265359.875273:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789265359.875275:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789265359.875276:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265359.875277:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265359.875279:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265359.875280:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265359.875282:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265359.875283:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265359.875285:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265359.875286:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265359.875288:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789265359.875293:0:8427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789265359.875300:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265359.875301:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789265359.875302:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265359.875303:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265359.875304:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265359.875305:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265359.875306:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265359.875306:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789265359.875308:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789265359.875308:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265359.875309:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789265359.875331:0:8427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789265359.875349:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578884480:0@lo:253: 00000100:00100000:3.0:1789265359.875405:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789265359.875690:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93775285d180 x1876180578884352/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265359.875700:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265359.876110:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789265359.876120:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789265359.876125:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789265359.876128:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937641a6d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789265359.876136:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180578884352:0@lo:38: 00000100:00100000:2.0:1789265359.876171:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578884480 00000100:00100000:2.0:1789265359.876177:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578884480 00000100:00100000:2.0:1789265359.876221:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789265359.876230:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:8427:x1876180578884480:12345-0@lo:253: 20000000:01000000:2.0:1789265359.876257:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789265359.876274:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789265359.876471:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62e40 going to sleep for 11 seconds 20000000:01000000:2.0:1789265359.887772:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789265359.887794:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789265359.888022:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789265359.888028:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789265359.888051:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.888069:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937740031400/0xbbfdc9019c1d36d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36cd expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.888078:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d36f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d36e9 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.888086:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.888126:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d36f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d36e9 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.888142:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d36f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36e9 expref: 16 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.888157:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876180578884608:0@lo:104: 00000100:00100000:0.0:1789265359.888229:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265359.888288:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937740031400/0xbbfdc9019c1d36d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d36cd expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265359.888298:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937740031400/0xbbfdc9019c1d36d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36cd expref: 16 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265359.888306:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876180578884736:0@lo:104: 00000100:00100000:0.0:1789265359.888325:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265359.888484:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:8427:x1876180578884480:12345-0@lo:253: Request processed in 12253us (13077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265359.888496:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789265359.888607:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789265359.888625:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265359.888687:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578884608 00000100:00100000:3.0:1789265359.888695:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578884608 00000100:00100000:0.0:1789265359.888792:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:8427:1876180578884480:0@lo:253: 10000000:01000000:0.0:1789265359.888805:0:8427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789265359.888808:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265359.888810:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789265359.888811:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265359.888813:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265359.888814:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265359.888815:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265359.888817:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265359.888818:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265359.888820:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265359.888821:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265359.888823:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789265359.888839:0:8427:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789265359.892043:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578884736 00000100:00100000:1.0:1789265359.892059:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578884736 00000100:00100000:1.0:1789265359.892106:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265359.892117:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+4:6535:x1876180578884608:12345-0@lo:104: 00010000:00010000:1.0:1789265359.892135:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d36e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d36f0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.892235:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265359.892255:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+4:6535:x1876180578884608:12345-0@lo:104: Request processed in 140us (4025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265359.892262:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265359.892304:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265359.892310:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:6535:x1876180578884736:12345-0@lo:104: 00010000:00010000:1.0:1789265359.892318:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d36cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d36d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.892352:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789265359.892357:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:6535:x1876180578884736:12345-0@lo:104: Request processed in 49us (3732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265359.892363:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789265359.892389:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265359.892395:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d36e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d36f0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.892402:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd800 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265359.892406:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d36e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d36f0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.892415:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d36e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d36f0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265359.892422:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d36e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d36f0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265359.892746:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265359.892785:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d36e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36f0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.892802:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265359.892825:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d36e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36f0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.892831:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d36e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36f0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.892846:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265359.892849:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d36cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d36d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.892854:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fc400 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265359.892857:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d36cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d36d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.892890:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d36cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d36d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265359.892896:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d36cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d36d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265359.892901:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265359.892914:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d36cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.892920:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265359.892925:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d36cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.892930:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d36cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d36d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.892951:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265359.892953:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265359.892955:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265359.892962:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265359.892980:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578884864:0@lo:103: 00000100:00100000:1.0:1789265359.893023:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265359.893068:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265359.893074:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578884992:0@lo:103: 00000100:00100000:1.0:1789265359.893095:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265359.893129:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578884864 00000100:00100000:1.0:1789265359.893134:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578884864 00010000:00010000:1.0:1789265359.893154:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d36f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36e9 expref: 16 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265359.893178:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578884992 00000100:00100000:1.0:1789265359.893181:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578884992 00010000:00010000:1.0:1789265359.893192:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937740031400/0xbbfdc9019c1d36d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36cd expref: 17 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265359.893209:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265359.893215:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+17:3643:x1876180578884864:12345-0@lo:103: 00010000:00010000:1.0:1789265359.893225:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265359.893230:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d36f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36e9 expref: 17 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893240:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d36f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36e9 expref: 17 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893267:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265359.893296:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+17:3643:x1876180578884864:12345-0@lo:103: Request processed in 81us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265359.893303:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265359.893317:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265359.893324:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+16:3643:x1876180578884992:12345-0@lo:103: 00010000:00010000:1.0:1789265359.893331:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265359.893335:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937740031400/0xbbfdc9019c1d36d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36cd expref: 16 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893343:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937740031400/0xbbfdc9019c1d36d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d36cd expref: 16 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893355:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893363:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789265359.893378:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008310862s 00010000:00010000:1.0:1789265359.893382:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893390:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893397:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893403:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893416:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265359.893420:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893428:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893435:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893444:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265359.893467:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+16:3643:x1876180578884992:12345-0@lo:103: Request processed in 143us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265359.893473:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265359.893520:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578884992:0@lo:103: 00000100:00100000:1.0:1789265359.893528:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578884864:0@lo:103: 00010000:00010000:1.0:1789265359.893560:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d36f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d36e9 expref: 15 pid: 6513 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265359.893570:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876180578884608:0@lo:104: 00010000:00010000:1.0:1789265359.893579:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937740031400/0xbbfdc9019c1d36d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d36cd expref: 14 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265359.893586:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876180578884736:0@lo:104: 00010000:00010000:1.0:1789265359.893601:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893618:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893623:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265359.893629:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937740031000/0xbbfdc9019c1d37de lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789265359.895998:0:8427:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789265359.896231:0:8427:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789265359.896422:0:8427:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789265359.896597:0:8427:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789265359.897428:0:8427:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789265359.897655:0:8427:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1789265359.899394:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789265359.919004:0:8427:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789265359.919017:0:8427:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789265359.919070:0:8427:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789265359.919117:0:8427:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789265359.919147:0:8427:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789265359.919168:0:8427:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789265359.920295:0:8427:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265359.920503:0:8427:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1789265360.373362:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578885120:0@lo:41: 00000100:00100000:2.0:1789265360.373438:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265360.373498:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578885120 00000100:00100000:0.0:1789265360.373507:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578885120 00000100:00100000:0.0:1789265360.373561:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265360.373572:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578885120:12345-0@lo:41: 00000004:00000024:0.0:1789265360.373606:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789265360.373656:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578885120:12345-0@lo:41: Request processed in 85us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265360.373677:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265360.373775:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578885120:0@lo:41: 00000100:00100000:3.0:1789265360.385254:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578885248:0@lo:41: 00000100:00100000:3.0:1789265360.385337:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265360.385543:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578885248 00000100:00100000:2.0:1789265360.385552:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578885248 00000100:00100000:2.0:1789265360.385604:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265360.385614:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578885248:12345-0@lo:41: 00000004:00000024:2.0:1789265360.385648:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789265360.386807:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578885248:12345-0@lo:41: Request processed in 1187us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265360.386819:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265360.392473:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578885248:0@lo:41: 00010000:00010000:0.0:1789265360.449378:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265361.288687:0:8511:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265361.289270:0:8511:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789265361.460251:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265362.494772:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265363.506995:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265364.533244:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265364.982059:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578885632:0@lo:400: 00000100:00100000:0.0:1789265364.982142:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265364.982197:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578886144:0@lo:400: 00000100:00100000:0.0:1789265364.982230:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265364.982263:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265364.982398:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578885760:0@lo:400: 00000100:00100000:0.0:1789265364.982433:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265364.982507:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578885504:0@lo:400: 00000100:00100000:0.0:1789265364.982534:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265364.982602:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578886016:0@lo:400: 00000100:00100000:3.0:1789265364.982872:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578885376:0@lo:400: 00000100:00100000:3.0:1789265364.982914:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265364.982948:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578885888:0@lo:400: 00000100:00100000:1.0:1789265364.983692:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578886144 00000100:00100000:1.0:1789265364.983705:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578886144 00000100:00100000:1.0:1789265364.983769:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578885760 00000100:00100000:1.0:1789265364.983772:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578885760 00000100:00100000:1.0:1789265364.983782:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578885504 00000100:00100000:1.0:1789265364.983784:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578885504 00000100:00100000:1.0:1789265364.983797:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265364.983805:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578886144:12345-0@lo:400: 00000100:00100000:1.0:1789265364.984005:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578886144:12345-0@lo:400: Request processed in 200us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265364.984014:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265364.984033:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265364.984039:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578885760:12345-0@lo:400: 00000100:00100000:1.0:1789265364.984070:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578885760:12345-0@lo:400: Request processed in 32us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265364.984083:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265364.984096:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789265364.984101:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578885504:12345-0@lo:400: 00000100:00100000:1.0:1789265364.984130:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578885504:12345-0@lo:400: Request processed in 29us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265364.984136:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789265364.984163:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789265364.984200:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93775285f100 x1876180578885760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265364.984215:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578885760:0@lo:400: 00010000:00080000:1.0:1789265364.984233:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93775285d180 x1876180578886144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265364.984240:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578886144:0@lo:400: 00000100:00100000:0.0:1789265364.984449:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789265364.984497:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93775285fb80 x1876180578885504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265364.984507:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578885504:0@lo:400: 00000100:00100000:0.0:1789265364.984531:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578886016 00000100:00100000:0.0:1789265364.984534:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578886016 00000100:00100000:0.0:1789265364.984563:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265364.984572:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578886016:12345-0@lo:400: 00000100:00100000:0.0:1789265364.984608:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578886016:12345-0@lo:400: Request processed in 39us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265364.984615:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265364.984624:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789265364.984640:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93775285d500 x1876180578886016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265364.984650:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578886016:0@lo:400: 00000100:00100000:3.0:1789265364.984663:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578885632 00000100:00100000:3.0:1789265364.984678:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578885632 00000100:00100000:3.0:1789265364.984698:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578885888 00000100:00100000:3.0:1789265364.984700:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578885888 00000100:00100000:3.0:1789265364.984714:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789265364.984720:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578885632:12345-0@lo:400: 00000100:00080000:1.0:1789265364.984724:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265364.984764:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578885632:12345-0@lo:400: Request processed in 44us (2621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265364.984771:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789265364.984783:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265364.984789:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578885888:12345-0@lo:400: 00000100:00100000:3.0:1789265364.984826:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578885888:12345-0@lo:400: Request processed in 38us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265364.984826:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578885632:0@lo:400: 00000100:00100000:3.0:1789265364.984832:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265364.984853:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578885376 00000100:00100000:3.0:1789265364.984857:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578885376 00000100:00100000:3.0:1789265364.984903:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789265364.984910:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+14:3643:x1876180578885376:12345-0@lo:400: 00000100:00100000:3.0:1789265364.984941:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+14:3643:x1876180578885376:12345-0@lo:400: Request processed in 32us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265364.984947:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789265364.985052:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578885376:0@lo:400: 00000100:00100000:0.0:1789265364.985063:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578885888:0@lo:400: 00000100:00100000:1.0:1789265365.491210:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578886272:0@lo:41: 00000100:00100000:1.0:1789265365.491296:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265365.491383:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578886272 00000100:00100000:1.0:1789265365.491391:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578886272 00000100:00100000:1.0:1789265365.491438:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265365.491447:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578886272:12345-0@lo:41: 00000004:00000024:1.0:1789265365.491765:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789265365.491827:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578886272:12345-0@lo:41: Request processed in 379us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265365.491852:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265365.491934:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578886272:0@lo:41: 10000000:01000000:3.0:1789265365.492120:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789265365.492124:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93774e5c3000 from 30 10000000:01000000:3.0:1789265365.492128:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265365.492165:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265365.492190:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265365.492201:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265365.492220:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578886400:0@lo:101: 00000100:00100000:3.0:1789265365.492259:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265365.492301:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377611763c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265365.492699:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578886400 00000100:00100000:1.0:1789265365.492708:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578886400 00000100:00100000:1.0:1789265365.492747:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789265365.492755:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+14:6516:x1876180578886400:12345-0@lo:101: 00010000:00010000:1.0:1789265365.492769:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265365.492784:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d37ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d37e5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265365.492811:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d37ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d37e5 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265365.492825:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d37ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d37e5 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265365.492836:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd400, rc 0) 00000100:00100000:1.0:1789265365.492893:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:6516:x1876180578886400:12345-0@lo:101: Request processed in 139us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265365.492900:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789265365.492941:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578886400:0@lo:101: 00010000:00010000:1.0:1789265365.494251:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d37ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265365.494272:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d37ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265365.494394:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578886528:0@lo:501: 00000100:00100000:1.0:1789265365.494466:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265365.494566:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265365.494688:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578886528 00000100:00100000:3.0:1789265365.494696:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578886528 00000100:00100000:3.0:1789265365.494747:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789265365.494756:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:6516:x1876180578886528:12345-0@lo:501: 00000100:00100000:3.0:1789265365.494935:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:6516:x1876180578886528:12345-0@lo:501: Request processed in 179us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265365.494942:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789265365.495184:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578886528:0@lo:501: 00000100:00100000:1.0:1789265365.495218:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578886656:0@lo:503: 00000100:00100000:1.0:1789265365.495261:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265365.495295:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265365.495412:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578886656 00000100:00100000:3.0:1789265365.495417:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578886656 00000100:00100000:3.0:1789265365.495454:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789265365.495461:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:6516:x1876180578886656:12345-0@lo:503: 00000100:00100000:3.0:1789265365.495561:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:6516:x1876180578886656:12345-0@lo:503: Request processed in 100us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265365.495568:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789265365.496353:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578886656:0@lo:503: 00000100:00100000:1.0:1789265365.496935:0:8705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8705:1876180578886784:0@lo:502: 00000100:00100000:1.0:1789265365.497075:0:8705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265365.497105:0:8705:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265365.497239:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578886912:0@lo:41: 00000100:00100000:2.0:1789265365.497274:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265365.497318:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578886912 00000100:00100000:2.0:1789265365.497324:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578886912 00000100:00100000:2.0:1789265365.497359:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265365.497367:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578886912:12345-0@lo:41: 00000004:00000024:2.0:1789265365.497396:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1789265365.497436:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578886912:12345-0@lo:41: Request processed in 69us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265365.497442:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265365.497556:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578886912:0@lo:41: 00000100:00100000:3.0:1789265365.497764:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578886784 00000100:00100000:3.0:1789265365.497769:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578886784 00000100:00100000:3.0:1789265365.497807:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789265365.497815:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:8705:x1876180578886784:12345-0@lo:502: 00000100:00100000:3.0:1789265365.498046:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:8705:x1876180578886784:12345-0@lo:502: Request processed in 232us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265365.498053:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789265365.498229:0:8705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8705:1876180578886784:0@lo:502: 00000100:00100000:1.0:1789265365.498283:0:8705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8705:1876180578887040:0@lo:502: 00000100:00100000:1.0:1789265365.498321:0:8705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265365.498357:0:8705:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265365.498420:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578887040 00000100:00100000:2.0:1789265365.498425:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578887040 00000100:00100000:2.0:1789265365.498470:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789265365.498477:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8705:x1876180578887040:12345-0@lo:502: 00000100:00100000:2.0:1789265365.498653:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:8705:x1876180578887040:12345-0@lo:502: Request processed in 176us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265365.498742:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789265365.498836:0:8705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8705:1876180578887040:0@lo:502: 00000040:00080000:1.0:1789265365.498894:0:8705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789265365.499215:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789265365.499236:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789265365.499246:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d37ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265365.499257:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d37ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265365.499268:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789265365.499270:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93774e5c3000 from 5 10000000:01000000:2.0:1789265365.499273:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789265365.499305:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265365.499313:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265365.499322:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265365.499338:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578887168:0@lo:101: 00000100:00100000:2.0:1789265365.499372:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265365.499406:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937747dd4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265365.499456:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578887168 00000100:00100000:3.0:1789265365.499462:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578887168 00000100:00100000:3.0:1789265365.499582:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789265365.499590:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:6516:x1876180578887168:12345-0@lo:101: 00010000:00010000:3.0:1789265365.499601:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265365.499614:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d37fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d37f3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265365.499635:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d37fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d37f3 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265365.499645:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d37fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d37f3 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265365.499652:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fde00, rc 0) 00000100:00100000:3.0:1789265365.499771:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578887168:12345-0@lo:101: Request processed in 182us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265365.499777:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789265365.500934:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578887168:0@lo:101: 00010000:00010000:2.0:1789265365.501057:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d37fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265365.501068:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d37fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265365.501135:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578887296:0@lo:256: 00000100:00100000:2.0:1789265365.501188:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265365.501227:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937747dd4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265365.501296:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578887296 00000100:00100000:3.0:1789265365.501303:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578887296 00000100:00100000:3.0:1789265365.501354:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789265365.501362:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578887296:12345-0@lo:256: 20000000:01000000:3.0:1789265365.501382:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789265365.501401:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789265365.501404:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789265365.501628:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578887296:12345-0@lo:256: Request processed in 266us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265365.501636:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789265365.501804:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578887296:0@lo:256: 10000000:01000000:1.0:1789265365.501856:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265365.501884:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d37fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265365.501891:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d37fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265365.501901:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789265365.501912:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1789265365.501914:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789265365.501944:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265365.502653:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265365.502763:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265365.502792:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578887424:0@lo:101: 00000100:00100000:1.0:1789265365.502854:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265365.502920:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265365.503293:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578887424 00000100:00100000:3.0:1789265365.503301:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578887424 00000100:00100000:3.0:1789265365.503355:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789265365.503364:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578887424:12345-0@lo:101: 00010000:00010000:3.0:1789265365.503379:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265365.503395:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377413fc400/0xbbfdc9019c1d3808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3801 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265365.503420:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377413fc400/0xbbfdc9019c1d3808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3801 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265365.503431:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377413fc400/0xbbfdc9019c1d3808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3801 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265365.503441:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fc400, rc 0) 00000100:00100000:3.0:1789265365.504082:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578887424:12345-0@lo:101: Request processed in 716us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265365.504090:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789265365.504293:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578887424:0@lo:101: 00010000:00010000:1.0:1789265365.504312:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3808 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265365.504322:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3808 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265365.504402:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578887552:0@lo:501: 00000100:00100000:1.0:1789265365.504442:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265365.504473:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265365.504759:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578887552 00000100:00100000:3.0:1789265365.504764:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578887552 00000100:00100000:3.0:1789265365.504811:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789265365.504821:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578887552:12345-0@lo:501: 00000100:00100000:3.0:1789265365.506204:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578887552:12345-0@lo:501: Request processed in 1377us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265365.506216:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789265365.506602:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578887552:0@lo:501: 00000100:00100000:1.0:1789265365.506653:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578887680:0@lo:503: 00000100:00100000:1.0:1789265365.506799:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265365.509267:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265365.513799:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578887680 00000100:00100000:2.0:1789265365.513818:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578887680 00000100:00100000:2.0:1789265365.515080:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789265365.515099:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578887680:12345-0@lo:503: 00000100:00100000:2.0:1789265365.515294:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578887680:12345-0@lo:503: Request processed in 202us (8494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265365.515303:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789265365.515450:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578887680:0@lo:503: 00000100:00100000:1.0:1789265365.515743:0:8706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8706:1876180578887808:0@lo:502: 00000100:00100000:1.0:1789265365.515788:0:8706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265365.518936:0:8706:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265365.519182:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578887808 00000100:00100000:2.0:1789265365.519192:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578887808 00000100:00100000:2.0:1789265365.519291:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789265365.519301:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:8706:x1876180578887808:12345-0@lo:502: 00000100:00100000:2.0:1789265365.519469:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:8706:x1876180578887808:12345-0@lo:502: Request processed in 169us (3679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265365.519477:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789265365.519600:0:8706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8706:1876180578887808:0@lo:502: 00000020:01000000:1.0:1789265365.519638:0:8706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789265365.519646:0:8706:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789265365.519653:0:8706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265365.519673:0:8706:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789265365.519679:0:8706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789265365.519683:0:8706:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:1.0:1789265365.519706:0:8706:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789265365.519709:0:8706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265365.519723:0:8706:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9377778c19b8) 00000020:00000080:1.0:1789265365.519744:0:8706:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1789265365.519750:0:8706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789265365.519834:0:8706:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789265365.519841:0:8706:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789265365.519847:0:8706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbbfdc9019c1d3816 00010000:00080000:1.0:1789265365.519937:0:8706:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93764213c800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1789265365.520209:0:8706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789265365.530801:0:8706:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789265365.530833:0:8706:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789265365.531127:0:8706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265365.531366:0:8706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265365.531473:0:8706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789265365.532094:0:8706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789265365.532881:0:8707:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265365.532892:0:8707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789265365.533834:0:8706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789265365.533849:0:8706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789265365.534129:0:8706:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789265365.534172:0:8706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbbfdc9019c1d381d 00000100:00080000:0.0:1789265365.534377:0:8706:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265365.534385:0:8706:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93764213c800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265365.534421:0:8706:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937642419c00 x1876180578887936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265365.534499:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180578887936:0@lo:8: 00000100:00100000:3.0:1789265365.534581:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789265365.534793:0:8706:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789265365.534889:0:8706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265365.534895:0:8706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265365.534897:0:8706:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789265365.534900:0:8706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265365.534905:0:8706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265365.534906:0:8706:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789265365.534909:0:8706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789265365.534911:0:8706:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789265365.534939:0:8706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8706:1876180578888064:0@lo:502: 00000100:00100000:0.0:1789265365.535065:0:8706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.535086:0:8706:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e787f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265365.535159:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578888192:0@lo:400: 00000100:00100000:0.0:1789265365.535290:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.535319:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265365.535325:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578888576:0@lo:400: 00000100:00100000:0.0:1789265365.535348:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.535378:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578888320:0@lo:400: 00000100:00100000:0.0:1789265365.535404:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.535423:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265365.535436:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764241ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578888448:0@lo:400: 00000100:00100000:0.0:1789265365.535459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.535559:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578888192 00000100:00100000:0.0:1789265365.535566:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578888192 00000100:00100000:0.0:1789265365.535600:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578888576 00000100:00100000:0.0:1789265365.535603:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578888576 00000100:00100000:0.0:1789265365.535614:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578888320 00000100:00100000:0.0:1789265365.535617:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578888320 00000100:00100000:0.0:1789265365.535626:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578888448 00000100:00100000:0.0:1789265365.535628:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578888448 00000100:00100000:0.0:1789265365.535642:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265365.535649:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578888192:12345-0@lo:400: 00000100:00100000:0.0:1789265365.536013:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578888192:12345-0@lo:400: Request processed in 363us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.536023:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265365.536041:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265365.536048:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578888576:12345-0@lo:400: 00000100:00100000:0.0:1789265365.536074:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578888576:12345-0@lo:400: Request processed in 28us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.536080:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265365.536091:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265365.536096:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578888320:12345-0@lo:400: 00000100:00100000:0.0:1789265365.536125:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578888320:12345-0@lo:400: Request processed in 28us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.536131:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265365.536141:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265365.536147:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578888448:12345-0@lo:400: 00000100:00100000:0.0:1789265365.536170:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578888448:12345-0@lo:400: Request processed in 24us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.536336:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1789265365.536377:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93764241ad80 x1876180578888448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265365.536390:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764241ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578888448:0@lo:400: 00010000:00080000:0.0:1789265365.536399:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642419180 x1876180578888320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265365.536407:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578888320:0@lo:400: 00000100:00100000:0.0:1789265365.536431:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578888064 00000100:00100000:0.0:1789265365.536434:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578888064 00000100:00100000:0.0:1789265365.536459:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789265365.536465:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:8706:x1876180578888064:12345-0@lo:502: 00000100:00100000:0.0:1789265365.536783:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:8706:x1876180578888064:12345-0@lo:502: Request processed in 318us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.536790:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789265365.536829:0:8706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8706:1876180578888064:0@lo:502: 00000020:01000000:0.0:1789265365.536852:0:8706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265365.536876:0:8706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265365.536878:0:8706:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789265365.536883:0:8706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00010000:00080000:2.0:1789265365.537138:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642419f80 x1876180578888576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265365.537149:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578888576:0@lo:400: 00010000:00080000:2.0:1789265365.537159:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642419500 x1876180578888192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265365.537174:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578888192:0@lo:400: 00000100:00100000:2.0:1789265365.537405:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578887936 00000100:00100000:2.0:1789265365.537411:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578887936 00000100:00100000:2.0:1789265365.537441:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265365.537447:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876180578887936:12345-0@lo:8: 00010000:00080000:2.0:1789265365.537469:0:8434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:2.0:1789265365.537567:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbbfdc9019c1d3824 00002000:00100000:2.0:1789265365.537605:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9376420e3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789265365.537610:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1789265365.537613:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789265365.537683:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789265365.537927:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789265365.537950:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9376420e4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265365.538142:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876180578887936:12345-0@lo:8: Request processed in 693us (3561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265365.538149:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789265365.538344:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642419c00 x1876180578887936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265365.538354:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265365.538361:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789265365.538368:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789265365.538373:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789265365.538380:0:3642:0:(import.c:65:import_set_state_nolock()) ffff93764213c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789265365.538389:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789265365.538394:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180578887936:0@lo:8: 00000004:00080000:3.0:1789265365.538462:0:8707:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789265365.538590:0:8707:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 221199729339ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789265365.538595:0:8707:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789265365.540370:0:8708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1876180578888704:0@lo:700: 00000100:00100000:2.0:1789265365.540438:0:8708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265365.540470:0:8708:0:(client.c:2715:ptlrpc_set_wait()) set ffff937747dd4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265365.540618:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578888704 00000100:00100000:3.0:1789265365.540626:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578888704 00000100:00100000:3.0:1789265365.540708:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265365.540716:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8708:x1876180578888704:12345-0@lo:700: 00000100:00100000:3.0:1789265365.540752:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8442:1876180578888832:0@lo:700: 00000100:00100000:3.0:1789265365.540783:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265365.540802:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff937761554480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265365.540828:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578888832 00000100:00100000:3.0:1789265365.540832:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578888832 00000100:00100000:3.0:1789265365.540883:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265365.540890:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8442:x1876180578888832:12345-0@lo:700: 00000100:00080000:2.0:1789265365.542074:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789265365.542223:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000020:01000000:1.0:1789265365.542466:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1789265365.542509:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789265365.542520:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3808 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265365.542533:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3808 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265365.542562:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789265365.542565:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff937779e62800 from 30 10000000:01000000:1.0:1789265365.542568:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789265365.542601:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265365.542610:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265365.542620:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265365.542642:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578888960:0@lo:101: 00000100:00100000:1.0:1789265365.542719:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265365.542764:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265365.543343:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578888960 00000100:00100000:0.0:1789265365.543351:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578888960 00000100:00100000:0.0:1789265365.543414:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789265365.543425:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578888960:12345-0@lo:101: 00010000:00010000:0.0:1789265365.543441:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265365.543458:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937740031400/0xbbfdc9019c1d3832 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d382b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.543493:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937740031400/0xbbfdc9019c1d3832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d382b expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.543515:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937740031400/0xbbfdc9019c1d3832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d382b expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.543525:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740031400, rc 0) 00000100:00100000:0.0:1789265365.543585:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578888960:12345-0@lo:101: Request processed in 162us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.543591:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789265365.545051:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578888960:0@lo:101: 00010000:00010000:0.0:1789265365.545081:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3832 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.545092:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3832 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265365.545197:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578889088:0@lo:501: 00000100:00100000:0.0:1789265365.545250:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.545289:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e787240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265365.545308:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578889088 00000100:00100000:0.0:1789265365.545314:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578889088 00000100:00100000:0.0:1789265365.545358:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789265365.545367:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578889088:12345-0@lo:501: 00000100:00100000:0.0:1789265365.545509:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578889088:12345-0@lo:501: Request processed in 142us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.545516:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789265365.545564:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578889088:0@lo:501: 00000100:00100000:0.0:1789265365.545594:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578889216:0@lo:503: 00000100:00100000:0.0:1789265365.545634:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.545647:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775834a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789265365.545674:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578889216 00000100:00100000:0.0:1789265365.545678:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578889216 00000100:00100000:0.0:1789265365.545696:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789265365.545701:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578889216:12345-0@lo:503: 00000100:00100000:0.0:1789265365.545791:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578889216:12345-0@lo:503: Request processed in 89us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.545798:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789265365.545837:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578889216:0@lo:503: 00000100:00100000:3.0:1789265365.546381:0:8709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8709:1876180578889344:0@lo:502: 00000100:00100000:3.0:1789265365.546424:0:8709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265365.546459:0:8709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377615546c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265365.546508:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578889344 00000100:00100000:0.0:1789265365.546513:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578889344 00000100:00100000:0.0:1789265365.546548:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789265365.546555:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:8709:x1876180578889344:12345-0@lo:502: 00000100:00100000:0.0:1789265365.546648:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:8709:x1876180578889344:12345-0@lo:502: Request processed in 93us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.546655:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789265365.547227:0:8709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8709:1876180578889344:0@lo:502: 00000100:00100000:3.0:1789265365.547276:0:8709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8709:1876180578889472:0@lo:502: 00000100:00100000:3.0:1789265365.547312:0:8709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265365.547342:0:8709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377615546c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265365.547393:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578889472 00000100:00100000:0.0:1789265365.547398:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578889472 00000100:00100000:0.0:1789265365.547437:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789265365.547445:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:8709:x1876180578889472:12345-0@lo:502: 00000100:00100000:0.0:1789265365.547528:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:8709:x1876180578889472:12345-0@lo:502: Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.547535:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789265365.549231:0:8709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8709:1876180578889472:0@lo:502: 00000040:00080000:3.0:1789265365.549275:0:8709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789265365.549515:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789265365.549542:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265365.549553:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3832 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.549563:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3832 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265365.549633:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265365.549635:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff937779e62800 from 5 10000000:01000000:0.0:1789265365.549638:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265365.549685:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.549693:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.549714:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265365.549737:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578889600:0@lo:101: 00000100:00100000:0.0:1789265365.549793:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.549831:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265365.549849:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578889600 00000100:00100000:0.0:1789265365.549854:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578889600 00000100:00100000:0.0:1789265365.549909:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789265365.549917:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578889600:12345-0@lo:101: 00010000:00010000:0.0:1789265365.549930:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265365.549942:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937740031800/0xbbfdc9019c1d3840 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3839 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.549964:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937740031800/0xbbfdc9019c1d3840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3839 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.549974:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937740031800/0xbbfdc9019c1d3840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3839 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.549984:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740031800, rc 0) 00000100:00100000:0.0:1789265365.550019:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+19:6516:x1876180578889600:12345-0@lo:101: Request processed in 102us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.550025:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789265365.550069:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578889600:0@lo:101: 00010000:00010000:0.0:1789265365.550082:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3840 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.550102:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3840 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265365.550147:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578889728:0@lo:256: 00000100:00100000:0.0:1789265365.550177:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.550190:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265365.550202:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578889728 00000100:00100000:0.0:1789265365.550206:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578889728 00000100:00100000:0.0:1789265365.550228:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789265365.550233:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+19:6516:x1876180578889728:12345-0@lo:256: 20000000:01000000:0.0:1789265365.550246:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789265365.550264:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789265365.550267:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789265365.550339:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+19:6516:x1876180578889728:12345-0@lo:256: Request processed in 105us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.550345:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789265365.550375:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578889728:0@lo:256: 10000000:01000000:0.0:1789265365.550414:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265365.550419:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3840 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.550427:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3840 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265365.550435:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789265365.550436:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789265365.550439:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789265365.550459:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.550466:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.550474:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265365.550486:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578889856:0@lo:101: 00000100:00100000:0.0:1789265365.550510:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.550525:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265365.550537:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578889856 00000100:00100000:0.0:1789265365.550540:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578889856 00000100:00100000:0.0:1789265365.550560:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789265365.550566:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+19:6516:x1876180578889856:12345-0@lo:101: 00010000:00010000:0.0:1789265365.550572:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265365.550581:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937740030600/0xbbfdc9019c1d384e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3847 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.550594:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937740030600/0xbbfdc9019c1d384e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3847 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.550603:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937740030600/0xbbfdc9019c1d384e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3847 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.550609:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740030600, rc 0) 00000100:00100000:0.0:1789265365.550635:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578889856:12345-0@lo:101: Request processed in 69us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.550641:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789265365.550692:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578889856:0@lo:101: 00010000:00010000:0.0:1789265365.550702:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d384e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.550711:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d384e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265365.550757:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578889984:0@lo:501: 00000100:00100000:0.0:1789265365.550780:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.550792:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265365.550803:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578889984 00000100:00100000:0.0:1789265365.550806:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578889984 00000100:00100000:0.0:1789265365.550825:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789265365.550830:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578889984:12345-0@lo:501: 00000100:00100000:0.0:1789265365.550960:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578889984:12345-0@lo:501: Request processed in 129us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.550967:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789265365.550996:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578889984:0@lo:501: 00000100:00100000:0.0:1789265365.551019:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578890112:0@lo:503: 00000100:00100000:0.0:1789265365.551056:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.551067:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265365.551078:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578890112 00000100:00100000:0.0:1789265365.551081:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578890112 00000100:00100000:0.0:1789265365.551099:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789265365.551105:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578890112:12345-0@lo:503: 00000100:00100000:0.0:1789265365.551176:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578890112:12345-0@lo:503: Request processed in 70us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.551191:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789265365.551227:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578890112:0@lo:503: 00010000:00010000:1.0:1789265365.558068:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265365.562038:0:8710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8710:1876180578890240:0@lo:502: 00000100:00100000:3.0:1789265365.562127:0:8710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265365.562164:0:8710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377615546c0 going to sleep for 11 seconds 40000000:02000000:2.0:1789265365.562966:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1789265365.564766:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578890240 00000100:00100000:0.0:1789265365.564780:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578890240 00000100:00100000:0.0:1789265365.564840:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789265365.564850:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:8710:x1876180578890240:12345-0@lo:502: 00000100:00100000:0.0:1789265365.565038:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:8710:x1876180578890240:12345-0@lo:502: Request processed in 189us (2910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.565046:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789265365.566794:0:8710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8710:1876180578890240:0@lo:502: 00000020:01000000:3.0:1789265365.566843:0:8710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265365.566852:0:8710:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789265365.566877:0:8710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265365.566880:0:8710:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789265365.566885:0:8710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265365.566889:0:8710:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:3.0:1789265365.566914:0:8710:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789265365.566917:0:8710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265365.566946:0:8710:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9376424f4d28) 00000020:00000080:3.0:1789265365.566971:0:8710:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1789265365.566978:0:8710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265365.567085:0:8710:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789265365.567092:0:8710:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789265365.567099:0:8710:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d385c 00010000:00080000:3.0:1789265365.567131:0:8710:0:(ldlm_lib.c:102:import_set_conn()) imp ffff937642504000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1789265365.567358:0:8710:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:2.0:1789265365.572947:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8442:x1876180578888832:12345-0@lo:700: Request processed in 32048us (32153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265365.572974:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789265365.576081:0:8442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93775285f480 x1876180578888832/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789265381 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265365.576102:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8442:1876180578888832:0@lo:700: 40000000:02000000:3.0:1789265365.576118:0:8442:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:1.0:1789265365.592016:0:8710:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789265365.592045:0:8710:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789265365.592304:0:8710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265365.592520:0:8710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265365.592627:0:8710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789265365.592738:0:8710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789265365.600804:0:8711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265365.600815:0:8711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000001:00100000:0.0:1789265365.608472:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789265365.609068:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8708:x1876180578888704:12345-0@lo:700: Request processed in 68346us (68623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265365.609087:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789265365.609427:0:8708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f37ca80 x1876180578888704/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789265381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265365.609450:0:8708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1876180578888704:0@lo:700: 00000020:00000080:1.0:1789265365.613742:0:8710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789265365.613761:0:8710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789265365.613822:0:8710:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789265365.613848:0:8710:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbbfdc9019c1d3863 00000100:00080000:1.0:1789265365.613887:0:8710:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265365.613895:0:8710:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff937642504000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1789265365.613932:0:8710:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93775dc26680 x1876180578890368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265365.613958:0:8710:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789265365.614023:0:8710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265365.614027:0:8710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265365.614029:0:8710:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789265365.614032:0:8710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265365.614036:0:8710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265365.614037:0:8710:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789265365.614040:0:8710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265365.614041:0:8710:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789265365.614071:0:8710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8710:1876180578890496:0@lo:502: 00000100:00100000:1.0:1789265365.614156:0:8710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265365.614205:0:8710:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e72c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789265365.615680:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180578890368:0@lo:8: 00000100:00100000:3.0:1789265365.615751:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265365.615818:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578890496 00000100:00100000:3.0:1789265365.615834:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578890496 00000100:00100000:3.0:1789265365.615910:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789265365.615921:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+20:8710:x1876180578890496:12345-0@lo:502: 00000100:00100000:3.0:1789265365.616057:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+20:8710:x1876180578890496:12345-0@lo:502: Request processed in 139us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265365.616065:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789265365.618179:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578890368 00000100:00100000:2.0:1789265365.618190:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578890368 00000100:00100000:2.0:1789265365.618235:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265365.618243:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876180578890368:12345-0@lo:8: 00010000:00080000:2.0:1789265365.618274:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:2.0:1789265365.618303:0:8436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbbfdc9019c1d386a 00002000:00100000:2.0:1789265365.618320:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9376420e6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789265365.618324:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789265365.618328:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789265365.618413:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789265365.618439:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9376420e1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265365.618528:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180578890368:12345-0@lo:8: Request processed in 283us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265365.618535:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265365.618588:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93775dc26680 x1876180578890368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265365.618600:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265365.618607:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789265365.618614:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789265365.618620:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789265365.618622:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937642504000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789265365.618635:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789265365.618640:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180578890368:0@lo:8: 00000004:00080000:2.0:1789265365.618778:0:8711:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789265365.618846:0:8711:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 221279985577ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789265365.618853:0:8711:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789265365.619019:0:8710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:8710:1876180578890496:0@lo:502: 00000020:01000000:1.0:1789265365.619068:0:8710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265365.619075:0:8710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265365.619076:0:8710:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789265365.619080:0:8710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789265365.619828:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789265365.619855:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789265365.620000:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d384e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265365.620013:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d384e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265365.620024:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789265365.620027:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93775f68cd28 from 1 10000000:01000000:2.0:1789265365.620030:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789265365.620064:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265365.620072:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265365.620082:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265365.620106:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578890624:0@lo:101: 00000100:00100000:2.0:1789265365.620164:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265365.620439:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937747dd4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265365.620535:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578890624 00000100:00100000:0.0:1789265365.620544:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578890624 00000100:00100000:0.0:1789265365.620590:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789265365.620598:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578890624:12345-0@lo:101: 00010000:00010000:0.0:1789265365.620612:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265365.620625:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937782163600/0xbbfdc9019c1d3878 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3871 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.620648:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937782163600/0xbbfdc9019c1d3878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3871 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.620726:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937782163600/0xbbfdc9019c1d3878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3871 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265365.620735:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937782163600, rc 0) 00000100:00100000:0.0:1789265365.620780:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578890624:12345-0@lo:101: Request processed in 183us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.620796:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000004:00080000:0.0:1789265365.621481:0:8708:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789265365.621507:0:8708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1876180578890880:0@lo:7: 00000100:00100000:0.0:1789265365.621551:0:8708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.621581:0:8708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265365.621602:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265365.621613:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578890752:0@lo:13: 00000100:00100000:0.0:1789265365.621643:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265365.621759:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578890752 00000100:00100000:0.0:1789265365.621765:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578890752 00000100:00100000:0.0:1789265365.621799:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265365.621807:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578890880 00000100:00100000:0.0:1789265365.621808:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578890752:12345-0@lo:13: 00000100:00100000:3.0:1789265365.621814:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578890880 00002000:00000024:0.0:1789265365.621838:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1789265365.621853:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265365.621886:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8708:x1876180578890880:12345-0@lo:7: 00000100:00100000:0.0:1789265365.621901:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1876180578890752:12345-0@lo:13: Request processed in 94us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.621908:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789265365.621946:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642419c00 x1876180578890752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265365.621965:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578890752:0@lo:13: 00000100:00100000:2.0:1789265365.622901:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578890624:0@lo:101: 00010000:00010000:2.0:1789265365.622922:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3878 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265365.622935:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3878 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265365.623016:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578891008:0@lo:501: 00000100:00100000:2.0:1789265365.623061:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265365.623095:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578891008 00000100:00100000:2.0:1789265365.623099:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937747dd4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265365.623102:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578891008 00000100:00100000:1.0:1789265365.623151:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789265365.623160:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775011b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578891008:12345-0@lo:501: 00000004:00080000:2.0:1789265365.623588:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789265365.625888:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775011b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578891008:12345-0@lo:501: Request processed in 2721us (2818us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265365.625927:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789265365.626141:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578891008:0@lo:501: 10000000:01000000:2.0:1789265365.626190:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789265365.626201:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3878 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265365.626213:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3878 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789265365.630830:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789265365.630839:0:8434:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789265365.631022:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8708:x1876180578890880:12345-0@lo:7: Request processed in 9157us (9465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265365.631034:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789265365.632846:0:8708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642418a80 x1876180578890880/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265381 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265365.632878:0:8708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1876180578890880:0@lo:7: 00000004:00080000:1.0:1789265365.632895:0:8708:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789265365.632938:0:8708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1876180578891136:0@lo:5: 00000100:00100000:1.0:1789265365.633000:0:8708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265365.633036:0:8708:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e72c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265365.633168:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578891136 00000100:00100000:3.0:1789265365.633174:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578891136 00000100:00100000:3.0:1789265365.633230:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265365.633237:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8708:x1876180578891136:12345-0@lo:5: 00002000:00080000:3.0:1789265365.633262:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789265365.633294:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8708:x1876180578891136:12345-0@lo:5: Request processed in 58us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265365.633298:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789265365.633323:0:8708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93775dc27800 x1876180578891136/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265381 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265365.633333:0:8708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1876180578891136:0@lo:5: 00000004:00080000:3.0:1789265365.633342:0:8708:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789265365.633380:0:8708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1876180578891264:0@lo:5: 00000100:00100000:3.0:1789265365.633399:0:8708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265365.633410:0:8708:0:(client.c:2715:ptlrpc_set_wait()) set ffff937761554540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265365.633419:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578891264 00000100:00100000:3.0:1789265365.633422:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578891264 00000100:00100000:3.0:1789265365.633439:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265365.633443:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8708:x1876180578891264:12345-0@lo:5: 00002000:00080000:3.0:1789265365.633461:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789265365.636706:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578891392:0@lo:13: 00000100:00100000:1.0:1789265365.636784:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789265365.636854:0:8712:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789265365.636900:0:8712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8712:1876180578891520:0@lo:7: 00000100:00100000:2.0:1789265365.636931:0:8712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265365.636949:0:8712:0:(client.c:2715:ptlrpc_set_wait()) set ffff937747dd4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265365.639007:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8708:x1876180578891264:12345-0@lo:5: Request processed in 5555us (5599us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789265365.639020:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265365.639048:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578891520 00000100:00100000:3.0:1789265365.639055:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578891520 00000100:00100000:3.0:1789265365.639445:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789265365.639451:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8712:x1876180578891520:12345-0@lo:7: 00000100:00100000:1.0:1789265365.641183:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578891392 00000100:00100000:1.0:1789265365.641195:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578891392 00000100:00100000:1.0:1789265365.641240:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265365.641249:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876180578891392:12345-0@lo:13: 00002000:00000024:1.0:1789265365.641271:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1789265365.641352:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876180578891392:12345-0@lo:13: Request processed in 105us (4567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265365.641358:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789265365.641415:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f37ca80 x1876180578891392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265365.641435:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578891392:0@lo:13: 00000100:00080000:1.0:1789265365.641915:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265365.641946:0:8708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93775285c700 x1876180578891264/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265365.641961:0:8708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1876180578891264:0@lo:5: 00000004:00080000:1.0:1789265365.641981:0:8708:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1789265365.642020:0:8708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc25880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8708:1876180578891648:0@lo:900: 00000100:00100000:1.0:1789265365.642058:0:8708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265365.642083:0:8708:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e72cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265365.642104:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578891648 00000100:00100000:1.0:1789265365.642108:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578891648 00000100:00100000:1.0:1789265365.642137:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265365.642145:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8708:x1876180578891648:12345-0@lo:900: 00000100:00100000:1.0:1789265365.642187:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8708:x1876180578891648:12345-0@lo:900: Request processed in 43us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265365.642194:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789265365.642225:0:8708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93775dc25880 x1876180578891648/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265365.642234:0:8708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc25880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8708:1876180578891648:0@lo:900: 00002000:00080000:3.0:1789265365.647590:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789265365.647601:0:8435:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789265365.647723:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8712:x1876180578891520:12345-0@lo:7: Request processed in 8264us (10785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265365.647735:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789265365.650917:0:8712:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f37ce00 x1876180578891520/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265381 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265365.650939:0:8712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8712:1876180578891520:0@lo:7: 00000004:00080000:2.0:1789265365.650955:0:8712:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789265365.651009:0:8712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8712:1876180578891776:0@lo:5: 00000100:00100000:2.0:1789265365.651073:0:8712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265365.651123:0:8712:0:(client.c:2715:ptlrpc_set_wait()) set ffff937747dd4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265365.651193:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578891776 00000100:00100000:3.0:1789265365.651200:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578891776 00000100:00100000:3.0:1789265365.651258:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265365.651268:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8712:x1876180578891776:12345-0@lo:5: 00002000:00080000:3.0:1789265365.651298:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789265365.651301:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1789265365.655740:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1789265365.655759:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789265365.655783:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789265365.655947:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8712:x1876180578891776:12345-0@lo:5: Request processed in 4676us (4869us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789265365.655958:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789265365.656015:0:8712:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f37ce00 x1876180578891776/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265381 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265365.656027:0:8712:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789265365.656034:0:8712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8712:1876180578891776:0@lo:5: 00000004:00080000:3.0:1789265365.656050:0:8712:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789265365.656104:0:8712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8712:1876180578891904:0@lo:700: 00000100:00100000:3.0:1789265365.656140:0:8712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265365.656176:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578891904 00000100:00100000:3.0:1789265365.656182:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578891904 00000100:00100000:3.0:1789265365.656221:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265365.656230:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8712:x1876180578891904:12345-0@lo:700: 00000100:00100000:3.0:1789265365.656393:0:8712:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775834a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789265365.671985:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8712:x1876180578891904:12345-0@lo:700: Request processed in 15746us (15835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265365.672007:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789265365.672102:0:8712:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93775285d500 x1876180578891904/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789265381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265365.672119:0:8712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8712:1876180578891904:0@lo:700: 00000004:02000040:3.0:1789265365.673026:0:8712:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1789265365.676209:0:8712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8712:1876180578892032:0@lo:5: 00000100:00100000:3.0:1789265365.676285:0:8712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265365.680897:0:8712:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775834a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265365.681011:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578892032 00000100:00100000:2.0:1789265365.681023:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578892032 00000100:00100000:2.0:1789265365.681098:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265365.681108:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8712:x1876180578892032:12345-0@lo:5: 00002000:00080000:2.0:1789265365.692212:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789265365.692232:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1789265365.693637:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8712:x1876180578892032:12345-0@lo:5: Request processed in 12526us (17346us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789265365.693650:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789265365.693903:0:8712:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93775285d500 x1876180578892032/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265365.693920:0:8712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8712:1876180578892032:0@lo:5: 00000004:00080000:0.0:1789265365.693942:0:8712:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1789265366.578996:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789265367.568840:0:8809:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789265367.604020:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265368.628963:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789265368.645393:0:8861:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265368.645730:0:8861:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:0.0:1789265369.499189:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1789265369.651286:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265370.624128:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265370.624158:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578892160:0@lo:41: 00000100:00100000:3.0:1789265370.624755:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265370.625180:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578892160 00000100:00100000:2.0:1789265370.625190:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578892160 00000100:00100000:2.0:1789265370.625259:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265370.625269:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578892160:12345-0@lo:41: 00000004:00000024:2.0:1789265370.625304:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789265370.625366:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578892160:12345-0@lo:41: Request processed in 99us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265370.625374:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265370.625588:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578892160:0@lo:41: 00000100:00100000:2.0:1789265370.626010:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265370.626024:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578892288:0@lo:41: 00000100:00100000:2.0:1789265370.626063:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265370.626095:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578892288 00000100:00100000:2.0:1789265370.626099:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578892288 00000100:00100000:2.0:1789265370.626127:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265370.626133:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578892288:12345-0@lo:41: 00000004:00000024:2.0:1789265370.626154:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789265370.626187:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578892288:12345-0@lo:41: Request processed in 54us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265370.626194:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265370.626225:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578892288:0@lo:41: 00010000:00010000:1.0:1789265370.675036:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265371.124900:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578892416:0@lo:400: 00000100:00100000:0.0:1789265371.124976:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265371.125024:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764241bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578892928:0@lo:400: 00000100:00100000:0.0:1789265371.125052:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265371.125078:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265371.125084:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764241b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578892800:0@lo:400: 00000100:00100000:0.0:1789265371.125108:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265371.125138:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578892544:0@lo:400: 00000100:00100000:0.0:1789265371.125162:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265371.125178:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764241b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578893056:0@lo:400: 00000100:00100000:0.0:1789265371.125202:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265371.125223:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789265371.125228:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764241a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578892672:0@lo:400: 00000100:00100000:0.0:1789265371.125266:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265371.125282:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578893184:0@lo:400: 00000100:00100000:0.0:1789265371.125302:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265371.125338:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578892416 00000100:00100000:0.0:1789265371.125345:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578892416 00000100:00100000:0.0:1789265371.125394:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789265371.125405:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:3644:x1876180578892416:12345-0@lo:400: 00000100:00100000:0.0:1789265371.125460:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:3644:x1876180578892416:12345-0@lo:400: Request processed in 57us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265371.125477:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789265371.125512:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578892928 00000100:00100000:0.0:1789265371.125516:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578892928 00000100:00100000:0.0:1789265371.125547:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578892800 00000100:00100000:0.0:1789265371.125550:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578892800 00000100:00100000:0.0:1789265371.125561:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578892544 00000100:00100000:0.0:1789265371.125564:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578892544 00000100:00100000:0.0:1789265371.125574:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578892672 00000100:00100000:0.0:1789265371.125577:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578892672 00000100:00100000:0.0:1789265371.125590:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789265371.125597:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578892928:12345-0@lo:400: 00000100:00100000:0.0:1789265371.125645:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578892928:12345-0@lo:400: Request processed in 49us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265371.125651:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789265371.125665:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265371.125671:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578892800:12345-0@lo:400: 00000100:00100000:0.0:1789265371.125698:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578892800:12345-0@lo:400: Request processed in 27us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265371.125703:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265371.125713:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265371.125718:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578892544:12345-0@lo:400: 00000100:00100000:0.0:1789265371.125746:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578892544:12345-0@lo:400: Request processed in 29us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265371.125751:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265371.125761:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265371.125767:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578892672:12345-0@lo:400: 00000100:00100000:0.0:1789265371.125791:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578892672:12345-0@lo:400: Request processed in 25us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265371.125804:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265371.125834:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578893056 00000100:00100000:0.0:1789265371.125838:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578893056 00000100:00100000:0.0:1789265371.125892:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578893184 00000100:00100000:0.0:1789265371.125896:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578893184 00000100:00100000:0.0:1789265371.125912:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265371.125918:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578893056:12345-0@lo:400: 00000100:00100000:0.0:1789265371.125967:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578893056:12345-0@lo:400: Request processed in 49us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265371.125974:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265371.125984:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265371.125990:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578893184:12345-0@lo:400: 00000100:00100000:0.0:1789265371.126013:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578893184:12345-0@lo:400: Request processed in 24us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265371.126019:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789265371.126043:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265371.126047:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265371.126050:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789265371.126080:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93764241a680 x1876180578892672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265371.126094:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764241a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578892672:0@lo:400: 00010000:00080000:0.0:1789265371.126105:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642419880 x1876180578893184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265371.126112:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789265371.126125:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578893184:0@lo:400: 00010000:00080000:0.0:1789265371.126135:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642418000 x1876180578892544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265371.126149:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578892544:0@lo:400: 00010000:00080000:0.0:1789265371.126163:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93764241b100 x1876180578893056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265371.126169:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789265371.126178:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764241b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578893056:0@lo:400: 00010000:00080000:0.0:1789265371.126210:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93764241b800 x1876180578892800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265371.126219:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764241b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578892800:0@lo:400: 00000100:00100000:0.0:1789265371.126229:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578892416:0@lo:400: 00010000:00080000:0.0:1789265371.126239:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93764241bb80 x1876180578892928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265371.126247:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764241bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578892928:0@lo:400: 00000100:00100000:0.0:1789265371.132849:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578893312:0@lo:13: 00000100:00100000:0.0:1789265371.132952:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265371.133006:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265371.133013:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578893440:0@lo:13: 00000100:00100000:0.0:1789265371.133037:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265371.133128:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578893312 00000100:00100000:1.0:1789265371.133139:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578893312 00000100:00100000:1.0:1789265371.133182:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578893440 00000100:00100000:1.0:1789265371.133186:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578893440 00000100:00100000:1.0:1789265371.133201:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265371.133210:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578893312:12345-0@lo:13: 00002000:00000024:1.0:1789265371.133244:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265371.133316:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578893312:12345-0@lo:13: Request processed in 105us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265371.133324:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265371.133342:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265371.133348:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578893440:12345-0@lo:13: 00002000:00000024:1.0:1789265371.133358:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265371.133379:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578893440:12345-0@lo:13: Request processed in 32us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265371.133384:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789265371.133514:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937779e55c00 x1876180578893440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265371.133534:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578893440:0@lo:13: 00010000:00080000:0.0:1789265371.133547:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93775dc25880 x1876180578893312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265371.133572:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578893312:0@lo:13: 00010000:00010000:1.0:1789265371.699091:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265371.860388:0:8963:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265371.862698:0:8963:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789265372.723119:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265372.997733:0:9011:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265372.997746:0:9011:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1789265373.748502:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265374.771223:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265375.731495:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578893568:0@lo:41: 00000100:00100000:0.0:1789265375.731578:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265375.731812:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578893568 00000100:00100000:3.0:1789265375.731821:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578893568 00000100:00100000:3.0:1789265375.731892:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789265375.731902:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578893568:12345-0@lo:41: 00000004:00000024:3.0:1789265375.731939:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789265375.731986:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578893568:12345-0@lo:41: Request processed in 85us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265375.731993:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789265375.732084:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578893568:0@lo:41: 00000100:00100000:0.0:1789265375.732716:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265375.732730:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578893696:0@lo:41: 00000100:00100000:0.0:1789265375.732767:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265375.732831:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578893696 00000100:00100000:3.0:1789265375.732836:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578893696 00000100:00100000:3.0:1789265375.732892:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265375.732899:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578893696:12345-0@lo:41: 00000004:00000024:3.0:1789265375.732921:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789265375.732962:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578893696:12345-0@lo:41: Request processed in 63us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265375.732968:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789265375.733048:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578893696:0@lo:41: 00010000:00010000:1.0:1789265375.808028:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265376.243084:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578893824:0@lo:13: 00000100:00100000:0.0:1789265376.243168:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265376.243251:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578893824 00000100:00100000:0.0:1789265376.243258:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578893824 00000100:00100000:0.0:1789265376.243311:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265376.243321:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578893824:12345-0@lo:13: 00002000:00000024:0.0:1789265376.243352:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265376.243405:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578893824:12345-0@lo:13: Request processed in 86us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265376.243412:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789265376.243433:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265376.243458:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937779e56d80 x1876180578893824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265376.243476:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578893824:0@lo:13: 00000100:00100000:2.0:1789265376.243791:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180578894336:0@lo:400: 00000100:00100000:2.0:1789265376.243834:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265376.243888:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789265376.243894:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578893952:0@lo:400: 00000100:00100000:2.0:1789265376.243924:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265376.243946:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578894464:0@lo:400: 00000100:00100000:2.0:1789265376.243966:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265376.243990:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578894080:0@lo:400: 00000100:00100000:2.0:1789265376.244013:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265376.244031:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578894592:0@lo:400: 00000100:00100000:2.0:1789265376.244053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265376.244071:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265376.244077:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578894208:0@lo:400: 00000100:00100000:2.0:1789265376.244097:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265376.244120:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578894336 00000100:00100000:2.0:1789265376.244124:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578894336 00000100:00100000:2.0:1789265376.244156:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578894464 00000100:00100000:2.0:1789265376.244158:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578894464 00000100:00100000:2.0:1789265376.244171:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578894080 00000100:00100000:2.0:1789265376.244174:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578894080 00000100:00100000:2.0:1789265376.244184:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578894208 00000100:00100000:2.0:1789265376.244186:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578894208 00000100:00100000:2.0:1789265376.244198:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265376.244204:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180578894336:12345-0@lo:400: 00000100:00100000:2.0:1789265376.244242:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180578894336:12345-0@lo:400: Request processed in 38us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.244255:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265376.244269:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265376.244275:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578894464:12345-0@lo:400: 00000100:00100000:2.0:1789265376.244302:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578894464:12345-0@lo:400: Request processed in 28us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.244308:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265376.244319:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265376.244324:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578894080:12345-0@lo:400: 00000100:00100000:2.0:1789265376.244353:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578894080:12345-0@lo:400: Request processed in 28us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.244358:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265376.244369:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265376.244374:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578894208:12345-0@lo:400: 00000100:00100000:2.0:1789265376.244414:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578894208:12345-0@lo:400: Request processed in 40us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.244421:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265376.244440:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578893952 00000100:00100000:2.0:1789265376.244444:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578893952 00000100:00100000:2.0:1789265376.244470:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789265376.244477:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:3643:x1876180578893952:12345-0@lo:400: 00000100:00100000:2.0:1789265376.244504:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:3643:x1876180578893952:12345-0@lo:400: Request processed in 28us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.244510:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789265376.244572:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578894592 00000100:00100000:2.0:1789265376.244576:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578894592 00000100:00100000:2.0:1789265376.244607:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265376.244621:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f29b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578894592:12345-0@lo:400: 00000100:00100000:2.0:1789265376.244651:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f29b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578894592:12345-0@lo:400: Request processed in 32us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265376.244657:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789265376.244671:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265376.244676:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265376.244678:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789265376.244706:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f37ce00 x1876180578894208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265376.244718:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578894208:0@lo:400: 00010000:00080000:2.0:1789265376.244731:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f37d180 x1876180578894080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265376.244738:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578894080:0@lo:400: 00010000:00080000:2.0:1789265376.244746:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f298000 x1876180578894592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265376.244753:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578894592:0@lo:400: 00000100:00100000:2.0:1789265376.244782:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578893952:0@lo:400: 00010000:00080000:2.0:1789265376.244790:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f298700 x1876180578894464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265376.244797:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578894464:0@lo:400: 00010000:00080000:2.0:1789265376.244806:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f37ca80 x1876180578894336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265376.244813:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180578894336:0@lo:400: 00000100:00100000:0.0:1789265376.246750:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265376.246778:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578894720:0@lo:13: 00000100:00100000:0.0:1789265376.246893:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265376.247072:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578894720 00000100:00100000:1.0:1789265376.247081:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578894720 00000100:00100000:1.0:1789265376.247135:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265376.247145:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578894720:12345-0@lo:13: 00002000:00000024:1.0:1789265376.247171:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265376.247255:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578894720:12345-0@lo:13: Request processed in 112us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265376.247264:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789265376.258074:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93775dc26680 x1876180578894720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265376.258107:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578894720:0@lo:13: 00010000:00010000:1.0:1789265376.819209:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265377.844683:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265378.883951:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265379.891650:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265380.851154:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265380.851383:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265380.851422:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578894976:0@lo:41: 00000100:00100000:2.0:1789265380.851490:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265380.851764:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578894976 00000100:00100000:0.0:1789265380.851773:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578894976 00000100:00100000:0.0:1789265380.851829:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265380.851840:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578894976:12345-0@lo:41: 00000004:00000024:0.0:1789265380.851903:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789265380.851960:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578894976:12345-0@lo:41: Request processed in 123us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265380.851967:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265380.852011:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578894976:0@lo:41: 00000100:00100000:1.0:1789265380.852367:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578894848:0@lo:41: 00000100:00100000:1.0:1789265380.852472:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265380.852965:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578894848 00000100:00100000:0.0:1789265380.852972:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578894848 00000100:00100000:0.0:1789265380.853047:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789265380.853056:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578894848:12345-0@lo:41: 00000004:00000024:0.0:1789265380.853095:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789265380.853152:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578894848:12345-0@lo:41: Request processed in 97us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265380.853159:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265380.853222:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578894848:0@lo:41: 00010000:00010000:1.0:1789265380.915264:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265381.366056:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578895104:0@lo:400: 00000100:00100000:2.0:1789265381.366137:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265381.367237:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578895488:0@lo:400: 00000100:00100000:1.0:1789265381.367294:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265381.370030:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578895616:0@lo:400: 00000100:00100000:2.0:1789265381.370124:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265381.370166:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578896128:0@lo:400: 00000100:00100000:2.0:1789265381.370190:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265381.370217:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789265381.370224:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578895232:0@lo:400: 00000100:00100000:2.0:1789265381.370250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265381.370269:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578895744:0@lo:400: 00000100:00100000:2.0:1789265381.370290:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265381.370457:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578895104 00000100:00100000:0.0:1789265381.370467:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578895104 00000100:00100000:0.0:1789265381.370537:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789265381.370547:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:3645:x1876180578895104:12345-0@lo:400: 00000100:00100000:2.0:1789265381.370568:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578895360:0@lo:400: 00000100:00100000:2.0:1789265381.370594:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265381.370604:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:3645:x1876180578895104:12345-0@lo:400: Request processed in 60us (4467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265381.370612:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578895872:0@lo:400: 00000100:00100000:0.0:1789265381.370624:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789265381.370630:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265381.370653:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578895488 00000100:00100000:2.0:1789265381.370657:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578895488 00000100:00100000:2.0:1789265381.370677:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578895232 00000100:00100000:2.0:1789265381.370679:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578895232 00000100:00100000:2.0:1789265381.370689:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578895744 00000100:00100000:2.0:1789265381.370691:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578895744 00000100:00100000:2.0:1789265381.370711:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578895872 00000100:00100000:2.0:1789265381.370713:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578895872 00000100:00100000:2.0:1789265381.370726:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789265381.370732:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578895488:12345-0@lo:400: 00000100:00100000:2.0:1789265381.370894:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578895488:12345-0@lo:400: Request processed in 161us (3598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265381.370900:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789265381.370912:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265381.370918:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578895232:12345-0@lo:400: 00000100:00100000:2.0:1789265381.370942:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578895232:12345-0@lo:400: Request processed in 24us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265381.370948:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265381.370959:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265381.370965:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578895744:12345-0@lo:400: 00000100:00100000:2.0:1789265381.370991:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578895744:12345-0@lo:400: Request processed in 27us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265381.370995:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265381.371005:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265381.371010:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578895872:12345-0@lo:400: 00000100:00100000:2.0:1789265381.371040:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578895872:12345-0@lo:400: Request processed in 29us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265381.371111:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265381.371131:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578895616 00000100:00100000:2.0:1789265381.371135:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578895616 00000100:00100000:2.0:1789265381.371153:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578895360 00000100:00100000:2.0:1789265381.371156:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578895360 00000100:00100000:2.0:1789265381.371168:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789265381.371174:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578895616:12345-0@lo:400: 00000100:00100000:2.0:1789265381.371205:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578895616:12345-0@lo:400: Request processed in 31us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265381.371220:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789265381.371232:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789265381.371237:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578895360:12345-0@lo:400: 00000100:00100000:2.0:1789265381.371263:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578895360:12345-0@lo:400: Request processed in 25us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265381.371268:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789265381.371285:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578896128 00000100:00100000:2.0:1789265381.371288:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578896128 00000100:00100000:2.0:1789265381.371313:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265381.371318:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578896128:12345-0@lo:400: 00010000:00080000:1.0:1789265381.373206:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f299c00 x1876180578895488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265381.373225:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578895488:0@lo:400: 00000100:00100000:1.0:1789265381.373240:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f29ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578896000:0@lo:400: 00000100:00100000:1.0:1789265381.373300:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265381.373440:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265381.373447:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578896384:0@lo:13: 00000100:00100000:1.0:1789265381.373485:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265381.373525:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578896384 00000100:00100000:1.0:1789265381.373531:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578896384 00000100:00100000:1.0:1789265381.373582:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265381.373590:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578896384:12345-0@lo:13: 00002000:00000024:1.0:1789265381.373619:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265381.373660:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578896384:12345-0@lo:13: Request processed in 70us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265381.373668:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789265381.373698:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93775dc25c00 x1876180578896384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265381.373714:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578896384:0@lo:13: 00000100:00100000:2.0:1789265381.376190:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578896128:12345-0@lo:400: Request processed in 4864us (5991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265381.376204:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265381.376232:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578896000 00000100:00100000:2.0:1789265381.376240:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578896000 00000100:00100000:2.0:1789265381.376273:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265381.376282:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578896000:12345-0@lo:400: 00000100:00100000:2.0:1789265381.376412:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578896000:12345-0@lo:400: Request processed in 131us (3111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265381.376419:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265381.376467:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578896256:0@lo:13: 00000100:00100000:2.0:1789265381.376559:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789265381.376602:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265381.376608:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265381.376611:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265381.376640:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578895360:0@lo:400: 00010000:00080000:2.0:1789265381.376677:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f299180 x1876180578895872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265381.376688:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578895872:0@lo:400: 00000100:00100000:2.0:1789265381.376735:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578896256 00000100:00100000:2.0:1789265381.376739:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578896256 00000100:00100000:2.0:1789265381.376758:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265381.376764:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578896256:12345-0@lo:13: 00002000:00000024:2.0:1789265381.376779:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265381.376818:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578896256:12345-0@lo:13: Request processed in 53us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265381.376824:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789265381.376853:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937779e54380 x1876180578896256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265381.376889:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578896256:0@lo:13: 00010000:00080000:2.0:1789265381.376920:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f29a300 x1876180578895232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265381.376930:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578895232:0@lo:400: 00010000:00080000:2.0:1789265381.376943:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f299500 x1876180578895744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265381.376951:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578895744:0@lo:400: 00000100:00100000:2.0:1789265381.376963:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578895104:0@lo:400: 00000100:00100000:2.0:1789265381.376975:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578895616:0@lo:400: 00010000:00080000:2.0:1789265381.376983:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f299f80 x1876180578896128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265381.376996:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578896128:0@lo:400: 00010000:00080000:1.0:1789265381.377165:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f29ad80 x1876180578896000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265381.377187:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f29ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578896000:0@lo:400: 00010000:00010000:1.0:1789265381.939344:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265382.963111:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265383.987542:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789265384.301962:0:9510:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789265384.301966:0:9510:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789265384.301968:0:9510:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789265384.302101:0:9510:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff937641a6a800 00000020:01000004:1.0:1789265384.302119:0:9510:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789265384.302138:0:9510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789265384.302162:0:9510:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9376426f4d28) 00000020:00000080:1.0:1789265384.302181:0:9510:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789265384.350342:0:9510:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789265384.350402:0:9510:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1789265384.386181:0:9510:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789265384.386474:0:9510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789265384.386501:0:9510:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789265384.386514:0:9510:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbbfdc9019c1d3886 00000020:01000004:1.0:1789265384.386521:0:9510:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789265384.386546:0:9510:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789265384.386551:0:9510:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789265384.386558:0:9510:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789265384.386587:0:9510:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789265384.386592:0:9510:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789265384.404574:0:9510:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789265384.404842:0:9510:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.142@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789265384.404847:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789265384.404848:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789265384.404850:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265384.404852:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265384.404853:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265384.404855:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265384.404857:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265384.404876:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265384.404883:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265384.404885:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265384.404887:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265384.404891:0:9510:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789265384.404893:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265384.404894:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789265384.404895:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265384.404896:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265384.404897:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265384.404898:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265384.404899:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265384.404900:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789265384.404901:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789265384.404902:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265384.404903:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265384.404929:0:9510:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789265384.404952:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578896512:0@lo:253: 00000100:00100000:1.0:1789265384.405045:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265384.405148:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265384.405599:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578896512 00000100:00100000:0.0:1789265384.405614:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578896512 00000100:00100000:0.0:1789265384.405696:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789265384.405707:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775011b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:9510:x1876180578896512:12345-0@lo:253: 20000000:01000000:0.0:1789265384.405742:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789265384.405746:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789265384.405752:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789265384.405756:0:6514:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789265384.406088:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265384.406224:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1789265384.406240:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789265384.406257:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1789265384.406263:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789265384.406291:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1789265384.406308:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1789265384.406397:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1789265384.406413:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.142@tcp 20000000:01000000:0.0:1789265384.406415:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:0.0:1789265384.406428:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1789265384.406433:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789265384.406446:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1789265384.406452:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:0.0:1789265384.406464:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1789265384.406470:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789265384.406505:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1789265384.406523:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1789265384.406603:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1789265384.406615:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.142@tcp 20000000:01000000:0.0:1789265384.406616:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:0.0:1789265384.406631:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1789265384.406636:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789265384.406648:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1789265384.406653:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:0.0:1789265384.406664:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1789265384.406670:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789265384.406683:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1789265384.406698:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1789265384.407118:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1789265384.407130:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.142@tcp 20000000:01000000:0.0:1789265384.407132:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:0.0:1789265384.407146:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1789265384.407151:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789265384.407178:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1789265384.407185:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:0.0:1789265384.407195:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1789265384.407200:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789265384.407210:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1789265384.407222:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1789265384.407234:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789265384.407237:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789265384.407240:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789265384.407281:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789265384.407284:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789265384.409669:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1789265384.409719:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1789265384.409737:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1789265384.410082:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1789265384.410110:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1789265384.410126:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1789265384.410138:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789265384.410141:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789265384.410716:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1789265384.410763:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1789265384.410790:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789265384.411058:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789265384.411090:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1789265384.411106:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1789265384.411117:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789265384.411119:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789265384.411417:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1789265384.411438:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1789265384.411468:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789265384.411736:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789265384.411758:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789265384.411774:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1789265384.411783:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789265384.411785:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789265384.412166:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1789265384.412184:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1789265384.412195:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1789265384.412329:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1789265384.412349:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1789265384.412365:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1789265384.412375:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789265384.412377:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789265384.423846:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1789265384.425344:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1789265384.425380:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1789265384.425397:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:1.0:1789265384.425416:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789265384.425438:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.425457:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937740031600/0xbbfdc9019c1d3783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d377c expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.425466:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d37ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d37a6 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.425473:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d37ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d37e5 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.425684:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377413fc400/0xbbfdc9019c1d3808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3801 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.425692:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937740031400/0xbbfdc9019c1d3832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d382b expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.425699:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937740030600/0xbbfdc9019c1d384e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3847 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.425706:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937782163600/0xbbfdc9019c1d3878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3871 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.425714:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.425752:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937782163600/0xbbfdc9019c1d3878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3871 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.425775:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937782163600/0xbbfdc9019c1d3878 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3871 expref: 21 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.425790:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc26300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578896640:0@lo:104: 00000100:00100000:1.0:1789265384.426096:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265384.426181:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937740030600/0xbbfdc9019c1d384e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3847 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.426189:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937740030600/0xbbfdc9019c1d384e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3847 expref: 21 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.426198:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc25880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578896768:0@lo:104: 00000100:00100000:1.0:1789265384.426221:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265384.426285:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937740031400/0xbbfdc9019c1d3832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d382b expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.426294:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937740031400/0xbbfdc9019c1d3832 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d382b expref: 21 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.426302:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f299f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578896896:0@lo:104: 00000100:00100000:1.0:1789265384.426320:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265384.426364:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578896640 00000100:00100000:2.0:1789265384.426372:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578896640 00000100:00100000:2.0:1789265384.426413:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578896768 00000100:00100000:2.0:1789265384.426415:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578896768 00000100:00100000:2.0:1789265384.426427:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265384.426435:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+4:6514:x1876180578896640:12345-0@lo:104: 00010000:00010000:2.0:1789265384.426450:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3878 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265384.426527:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265384.426533:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+4:6514:x1876180578896640:12345-0@lo:104: Request processed in 99us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265384.426540:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265384.426557:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265384.426563:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:6514:x1876180578896768:12345-0@lo:104: 00010000:00010000:2.0:1789265384.426571:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d384e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265384.426602:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265384.426607:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:6514:x1876180578896768:12345-0@lo:104: Request processed in 45us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265384.426613:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1789265384.426794:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265384.426802:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3878 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.426809:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167e400 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:0.0:1789265384.426814:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3878 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.426822:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3878 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265384.426829:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3878 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265384.426835:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265384.426896:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3878 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.426902:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265384.426933:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3878 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.426940:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff93774167e400/0xbbfdc9019c1d3871 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3878 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.426951:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265384.426955:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d384e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.426960:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030c00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:0.0:1789265384.426962:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d384e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.426968:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d384e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265384.426975:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d384e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265384.426979:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265384.426992:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d384e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.426997:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265384.427011:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d384e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.427017:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937740030c00/0xbbfdc9019c1d3847 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d384e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.427026:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265384.427033:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265384.427035:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265384.427049:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578897024:0@lo:103: 00000100:00100000:0.0:1789265384.427080:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265384.427118:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578897152:0@lo:103: 00000100:00100000:0.0:1789265384.427139:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265384.427169:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578897024 00000100:00100000:0.0:1789265384.427173:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578897024 00010000:00010000:0.0:1789265384.427194:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937782163600/0xbbfdc9019c1d3878 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3871 expref: 22 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265384.427212:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578897152 00000100:00100000:0.0:1789265384.427215:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578897152 00010000:00010000:0.0:1789265384.427223:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937740030600/0xbbfdc9019c1d384e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3847 expref: 23 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265384.427238:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265384.427244:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+23:3644:x1876180578897024:12345-0@lo:103: 00010000:00010000:0.0:1789265384.427255:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265384.427259:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937782163600/0xbbfdc9019c1d3878 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3871 expref: 23 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.427269:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937782163600/0xbbfdc9019c1d3878 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3871 expref: 23 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.427286:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265384.427310:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+23:3644:x1876180578897024:12345-0@lo:103: Request processed in 66us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265384.427316:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265384.427330:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265384.427341:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+22:3645:x1876180578897152:12345-0@lo:103: 00010000:00010000:0.0:1789265384.427347:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265384.427351:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937740030600/0xbbfdc9019c1d384e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3847 expref: 22 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.427359:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937740030600/0xbbfdc9019c1d384e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3847 expref: 22 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.427368:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265384.427390:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+22:3645:x1876180578897152:12345-0@lo:103: Request processed in 50us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265384.427395:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265384.427435:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578897152:0@lo:103: 00000100:00100000:0.0:1789265384.427455:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578897024:0@lo:103: 00010000:00010000:1.0:1789265384.427798:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377413fc400/0xbbfdc9019c1d3808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3801 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.427809:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377413fc400/0xbbfdc9019c1d3808 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3801 expref: 21 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.427818:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f298000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578897280:0@lo:104: 00000100:00100000:1.0:1789265384.427851:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265384.427893:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d37ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d37e5 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.427902:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d37ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d37e5 expref: 21 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.427910:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f29a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578897408:0@lo:104: 00000100:00100000:1.0:1789265384.427933:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265384.427949:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d37ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d37a6 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.427957:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d37ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d37a6 expref: 21 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.427965:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f298e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578897536:0@lo:104: 00000100:00100000:1.0:1789265384.427986:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265384.428002:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937740031600/0xbbfdc9019c1d3783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d377c expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.428009:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937740031600/0xbbfdc9019c1d3783 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d377c expref: 21 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.428016:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f299c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578897664:0@lo:104: 00000100:00100000:1.0:1789265384.428035:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760051840 going to sleep for 11 seconds 00010000:00010000:1.0:1789265384.428051:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937782163600/0xbbfdc9019c1d3878 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3871 expref: 21 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.428063:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc26300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578896640:0@lo:104: 00010000:00010000:1.0:1789265384.428073:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937740030600/0xbbfdc9019c1d384e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3847 expref: 20 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.428091:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc25880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578896768:0@lo:104: 00010000:00010000:1.0:1789265384.428108:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265384.428193:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789265384.428228:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265384.428239:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578896896 00000100:00100000:2.0:1789265384.428243:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578896896 00000100:00100000:2.0:1789265384.428269:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578897280 00000100:00100000:2.0:1789265384.428271:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578897280 00000100:00100000:2.0:1789265384.428278:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578897408 00000100:00100000:2.0:1789265384.428280:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578897408 00000100:00100000:2.0:1789265384.428288:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578897536 00000100:00100000:2.0:1789265384.428290:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578897536 00000100:00100000:2.0:1789265384.428297:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578897664 00000100:00100000:2.0:1789265384.428298:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578897664 00000100:00100000:2.0:1789265384.428308:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265384.428314:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+7:6514:x1876180578896896:12345-0@lo:104: 00010000:00010000:2.0:1789265384.428324:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3832 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265384.428374:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265384.428379:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+7:6514:x1876180578896896:12345-0@lo:104: Request processed in 65us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265384.428385:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265384.428397:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265384.428402:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f299500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+6:6514:x1876180578897280:12345-0@lo:104: 00010000:00010000:2.0:1789265384.428409:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3808 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265384.428438:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265384.428443:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f299500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+6:6514:x1876180578897280:12345-0@lo:104: Request processed in 41us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265384.428448:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265384.428459:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265384.428464:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f299180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+5:6514:x1876180578897408:12345-0@lo:104: 00010000:00010000:2.0:1789265384.428471:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d37ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.428571:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265384.428577:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3832 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.428584:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd200 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265384.428587:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3832 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.428595:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3832 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265384.428601:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3832 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265384.428607:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265384.428651:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3832 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.428657:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265384.428669:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3832 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.428675:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bd200/0xbbfdc9019c1d382b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3832 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.428686:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265384.428689:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3808 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.428699:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bda00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265384.428702:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3808 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.428708:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3808 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265384.428714:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3808 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265384.428719:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265384.428739:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3808 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.428745:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265384.428755:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3808 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.428761:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bda00/0xbbfdc9019c1d3801 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3808 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.428770:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265384.428771:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265384.428773:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265384.428794:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f299f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578896896:0@lo:104: 00000100:00100000:1.0:1789265384.428802:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f298000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578897280:0@lo:104: 00010000:00010000:2.0:1789265384.428974:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265384.428980:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f299180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+5:6514:x1876180578897408:12345-0@lo:104: Request processed in 516us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265384.428986:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265384.429000:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265384.429006:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+4:6514:x1876180578897536:12345-0@lo:104: 00010000:00010000:2.0:1789265384.429013:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d37ad expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265384.429034:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265384.429038:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+4:6514:x1876180578897536:12345-0@lo:104: Request processed in 34us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265384.429043:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265384.429072:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265384.429077:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642667100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:6514:x1876180578897664:12345-0@lo:104: 00010000:00010000:2.0:1789265384.429083:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3783 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265384.429102:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789265384.429106:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642667100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:6514:x1876180578897664:12345-0@lo:104: Request processed in 30us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265384.429111:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789265384.429186:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578897792:0@lo:103: 00000100:00100000:0.0:1789265384.429216:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265384.429263:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642750e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578897920:0@lo:103: 00000100:00100000:0.0:1789265384.429285:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265384.429310:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578897792 00000100:00100000:0.0:1789265384.429314:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578897792 00010000:00010000:0.0:1789265384.429331:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937740031400/0xbbfdc9019c1d3832 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d382b expref: 20 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265384.429347:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578897920 00000100:00100000:0.0:1789265384.429350:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578897920 00010000:00010000:0.0:1789265384.429357:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377413fc400/0xbbfdc9019c1d3808 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3801 expref: 21 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265384.429382:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265384.429387:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+21:3646:x1876180578897792:12345-0@lo:103: 00010000:00010000:0.0:1789265384.429395:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265384.429399:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937740031400/0xbbfdc9019c1d3832 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d382b expref: 21 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429409:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937740031400/0xbbfdc9019c1d3832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d382b expref: 21 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429422:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937740031400/0xbbfdc9019c1d3832 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d382b expref: 21 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429433:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265384.429455:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+20:3646:x1876180578897792:12345-0@lo:103: Request processed in 68us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265384.429461:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265384.429471:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265384.429476:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f67c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+19:3643:x1876180578897920:12345-0@lo:103: 00010000:00010000:0.0:1789265384.429500:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265384.429504:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377413fc400/0xbbfdc9019c1d3808 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3801 expref: 19 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429513:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377413fc400/0xbbfdc9019c1d3808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3801 expref: 19 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429522:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377413fc400/0xbbfdc9019c1d3808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3801 expref: 19 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429542:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265384.429564:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f67c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+18:3643:x1876180578897920:12345-0@lo:103: Request processed in 88us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265384.429570:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265384.429619:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642750e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578897920:0@lo:103: 00000100:00100000:0.0:1789265384.429764:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578897792:0@lo:103: 00010000:00010000:0.0:1789265384.429782:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789265384.429787:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d37ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429793:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fca00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:0.0:1789265384.429797:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d37ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429805:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d37ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265384.429811:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d37ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265384.429817:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265384.429838:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d37ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429843:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265384.429852:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d37ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429894:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377413fca00/0xbbfdc9019c1d37e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d37ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429905:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265384.429908:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d37ad expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429912:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fd200 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:0.0:1789265384.429915:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d37ad expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429921:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d37ad expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265384.429926:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d37ad expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265384.429931:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265384.429944:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d37ad expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429949:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265384.429958:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d37ad expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429965:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d37a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d37ad expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429974:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265384.429982:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3783 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429987:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030800 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:0.0:1789265384.429990:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3783 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.429996:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3783 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265384.430002:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3783 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265384.430007:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265384.430019:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3783 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.430024:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265384.430029:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3783 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.430034:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937740030800/0xbbfdc9019c1d377c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3783 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.430047:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265384.430049:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265384.430051:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265384.430066:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578898176:0@lo:103: 00000100:00100000:0.0:1789265384.430096:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265384.430117:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265384.430123:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578898304:0@lo:103: 00000100:00100000:0.0:1789265384.430149:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265384.430175:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578898176 00000100:00100000:0.0:1789265384.430179:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578898176 00010000:00010000:0.0:1789265384.430194:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d37ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d37a6 expref: 18 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265384.430212:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578898304 00000100:00100000:0.0:1789265384.430215:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578898304 00010000:00010000:0.0:1789265384.430223:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937740031600/0xbbfdc9019c1d3783 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d377c expref: 19 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265384.430234:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265384.430240:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+19:3645:x1876180578898176:12345-0@lo:103: 00010000:00010000:0.0:1789265384.430247:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265384.430250:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d37ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d37a6 expref: 19 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.430258:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d37ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d37a6 expref: 19 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.430268:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265384.430292:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+19:3645:x1876180578898176:12345-0@lo:103: Request processed in 52us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265384.430298:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265384.430311:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265384.430317:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+18:3645:x1876180578898304:12345-0@lo:103: 00010000:00010000:0.0:1789265384.430324:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265384.430328:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937740031600/0xbbfdc9019c1d3783 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d377c expref: 18 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.430345:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937740031600/0xbbfdc9019c1d3783 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d377c expref: 18 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.430355:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265384.430376:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+18:3645:x1876180578898304:12345-0@lo:103: Request processed in 59us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265384.430381:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265384.430402:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578898048:0@lo:103: 00000100:00100000:0.0:1789265384.430424:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265384.430461:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578898304:0@lo:103: 00000100:00100000:0.0:1789265384.430469:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578898176:0@lo:103: 00010000:00010000:1.0:1789265384.430634:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265384.430659:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f29a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578897408:0@lo:104: 00010000:00010000:1.0:1789265384.430677:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d37ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d37a6 expref: 17 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.430688:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f298e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578897536:0@lo:104: 00010000:00010000:1.0:1789265384.430697:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937740031600/0xbbfdc9019c1d3783 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d377c expref: 16 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.430705:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f299c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876180578897664:0@lo:104: 00010000:00010000:1.0:1789265384.430736:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.430906:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578898048 00000100:00100000:1.0:1789265384.430911:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578898048 00010000:00010000:1.0:1789265384.430929:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d37ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d37e5 expref: 16 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.430950:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789265384.430956:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+16:3644:x1876180578898048:12345-0@lo:103: 00010000:00010000:1.0:1789265384.430965:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265384.430969:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d37ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d37e5 expref: 16 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.430979:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d37ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d37e5 expref: 16 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.430990:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d37ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d37e5 expref: 16 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.431002:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.431017:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.431031:0:7460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.431038:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.431044:0:7460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.431050:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.431054:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd800 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265384.431058:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.431064:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.431078:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.431087:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265384.431124:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+15:3644:x1876180578898048:12345-0@lo:103: Request processed in 167us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.431130:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789265384.431149:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.431162:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.431169:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d388d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789265384.431181:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789265384.433323:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578898048:0@lo:103: 00000100:00100000:1.0:1789265384.434376:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775011b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+14:9510:x1876180578896512:12345-0@lo:253: Request processed in 28664us (29323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.434388:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789265384.434477:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578896512:0@lo:253: 10000000:01000000:0.0:1789265384.434509:0:9510:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789265384.434512:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265384.434514:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789265384.434515:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265384.434517:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789265384.434518:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265384.434519:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265384.434521:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265384.434523:0:9510:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789265384.434524:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265384.434525:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789265384.434544:0:9510:0:(tgt_mount.c:101:server_register_mount()) register mount ffff937641a6a800 from lustre-OST0001 10000000:01000000:0.0:1789265384.434573:0:9510:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789265384.434576:0:9510:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789265384.434583:0:9510:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93775f68cd28 local copy 10000000:01000000:0.0:1789265384.434597:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789265384.434646:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.434657:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.434667:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265384.434685:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578898432:0@lo:101: 00000100:00100000:0.0:1789265384.434725:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265384.434764:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265384.434909:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578898432 00000100:00100000:1.0:1789265384.434916:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578898432 00000100:00100000:1.0:1789265384.434952:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789265384.434959:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+14:9510:x1876180578898432:12345-0@lo:101: 00010000:00010000:1.0:1789265384.434972:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265384.434984:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d389b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3894 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.435005:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d389b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3894 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.435015:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d389b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3894 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.435023:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bda00, rc 0) 00000100:00100000:1.0:1789265384.435058:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:9510:x1876180578898432:12345-0@lo:101: Request processed in 99us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.435063:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789265384.435171:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578898432:0@lo:101: 00010000:00010000:3.0:1789265384.435184:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbbfdc9019c1d389b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.435193:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbbfdc9019c1d389b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265384.435288:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578898560:0@lo:501: 00000100:00100000:3.0:1789265384.435316:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.435346:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789265384.435407:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578898560 00000100:00100000:0.0:1789265384.435411:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578898560 00000100:00100000:0.0:1789265384.435445:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789265384.435453:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:9510:x1876180578898560:12345-0@lo:501: 00000100:00100000:0.0:1789265384.435518:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:9510:x1876180578898560:12345-0@lo:501: Request processed in 67us (201us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265384.435525:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789265384.435596:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578898560:0@lo:501: 10000000:01000000:3.0:1789265384.435610:0:9510:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789265384.435637:0:9510:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789265384.435642:0:9510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbbfdc9019c1d389b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.435650:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbbfdc9019c1d389b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.435656:0:9510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbbfdc9019c1d389b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.435679:0:9510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789265384.435705:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff937641a6a800 10000000:01000000:3.0:1789265384.435710:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789265384.435714:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789265384.435717:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265384.435721:0:9510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789265384.435724:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789265384.435739:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.435747:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.435755:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265384.435767:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578898688:0@lo:101: 00000100:00100000:3.0:1789265384.435798:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.435809:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265384.435963:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578898688 00000100:00100000:0.0:1789265384.435967:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578898688 00000100:00100000:0.0:1789265384.436000:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789265384.436007:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:9510:x1876180578898688:12345-0@lo:101: 00010000:00010000:0.0:1789265384.436015:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265384.436024:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937782162800/0xbbfdc9019c1d38a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d38a2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.436039:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937782162800/0xbbfdc9019c1d38a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d38a2 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.436055:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937782162800/0xbbfdc9019c1d38a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d38a2 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.436062:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937782162800, rc 0) 00000100:00100000:0.0:1789265384.436091:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:9510:x1876180578898688:12345-0@lo:101: Request processed in 85us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265384.436097:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00010000:0.0:1789265384.436124:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265384.436130:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbbfdc9019c1d389b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.436138:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937782162a00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:0.0:1789265384.436142:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbbfdc9019c1d389b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.436151:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbbfdc9019c1d389b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265384.436158:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbbfdc9019c1d389b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265384.436163:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265384.436180:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbbfdc9019c1d389b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.436187:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265384.436205:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbbfdc9019c1d389b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.436223:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937782162a00/0xbbfdc9019c1d3894 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbbfdc9019c1d389b expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.436236:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265384.436238:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265384.436240:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265384.436252:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578898816:0@lo:103: 00000100:00100000:0.0:1789265384.436281:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.436358:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578898688:0@lo:101: 00010000:00010000:3.0:1789265384.436368:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d38a9 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.436376:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d38a9 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265384.436436:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578898944:0@lo:501: 00000100:00100000:3.0:1789265384.436459:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.436481:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265384.436558:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578898816 00000100:00100000:1.0:1789265384.436562:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578898816 00000100:00100000:1.0:1789265384.436601:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265384.436608:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+16:3643:x1876180578898816:12345-0@lo:103: 00010000:00010000:1.0:1789265384.436617:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265384.436726:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d389b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3894 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.436737:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265384.436809:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578898944 00000100:00100000:0.0:1789265384.436813:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578898944 00000100:00100000:0.0:1789265384.436835:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789265384.436841:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:9510:x1876180578898944:12345-0@lo:501: 00000100:00100000:0.0:1789265384.436947:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:9510:x1876180578898944:12345-0@lo:501: Request processed in 106us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265384.436954:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789265384.437018:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+15:3643:x1876180578898816:12345-0@lo:103: Request processed in 409us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.437025:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265384.437303:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578898816:0@lo:103: 00000100:00100000:3.0:1789265384.437336:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578898944:0@lo:501: 00000100:00100000:3.0:1789265384.437366:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899072:0@lo:503: 00000100:00100000:3.0:1789265384.437408:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.437443:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265384.437506:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578899072 00000100:00100000:1.0:1789265384.437511:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578899072 00000100:00100000:1.0:1789265384.437546:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789265384.437553:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:9510:x1876180578899072:12345-0@lo:503: 00000100:00100000:1.0:1789265384.437842:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+15:9510:x1876180578899072:12345-0@lo:503: Request processed in 289us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.437849:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789265384.438132:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899072:0@lo:503: 00000040:00080000:2.0:1789265384.438389:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265384.438552:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899200:0@lo:502: 00000100:00100000:2.0:1789265384.438599:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265384.438680:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff937756f0d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265384.438800:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578899200 00000100:00100000:1.0:1789265384.438805:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578899200 00000100:00100000:1.0:1789265384.438904:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789265384.438913:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:9510:x1876180578899200:12345-0@lo:502: 00000100:00100000:1.0:1789265384.439000:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:9510:x1876180578899200:12345-0@lo:502: Request processed in 88us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.439007:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789265384.439087:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899200:0@lo:502: 00000040:00080000:2.0:1789265384.439309:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789265384.439335:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789265384.439350:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789265384.439362:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789265384.439375:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789265384.439388:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789265384.439413:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899328:0@lo:502: 00000100:00100000:2.0:1789265384.439449:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265384.439796:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff937756f0d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265384.439877:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578899328 00000100:00100000:3.0:1789265384.439883:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578899328 00000100:00100000:3.0:1789265384.439916:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789265384.439923:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:9510:x1876180578899328:12345-0@lo:502: 00000100:00100000:3.0:1789265384.440012:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:9510:x1876180578899328:12345-0@lo:502: Request processed in 89us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265384.440019:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789265384.440106:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899328:0@lo:502: 00000040:00080000:2.0:1789265384.440150:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789265384.440158:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1789265384.440761:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789265384.440770:0:9521:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789265384.440777:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265384.440779:0:9521:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789265384.440784:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265384.440799:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93774f18cd28) 00000020:00000080:2.0:1789265384.440824:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789265384.440830:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789265384.440928:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff937641a6a800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789265384.440937:0:9521:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789265384.440944:0:9521:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbbfdc9019c1d38b7 00010000:00010000:2.0:1789265384.446462:0:9521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1789265384.447276:0:9521:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789265384.450564:0:9521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789265384.451137:0:9521:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789265384.456117:0:9521:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789265384.456336:0:9521:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789265384.462405:0:9521:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789265384.463740:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789265384.463752:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265384.463759:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265384.463762:0:9521:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789265384.463765:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265384.463769:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265384.463771:0:9521:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265384.463774:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265384.463776:0:9521:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789265384.463797:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265384.463800:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265384.463802:0:9521:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789265384.463805:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789265384.465652:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789265384.465702:0:9510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789265384.465733:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d38a9 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.465747:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d38a9 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265384.465755:0:9510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff937641a6a800 from 1 10000000:01000000:3.0:1789265384.465758:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265384.465795:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.465802:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.465814:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265384.465838:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899456:0@lo:101: 00000100:00100000:3.0:1789265384.465937:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.465980:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265384.466005:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578899456 00000100:00100000:3.0:1789265384.466012:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578899456 00000100:00100000:3.0:1789265384.466062:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789265384.466072:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+15:9510:x1876180578899456:12345-0@lo:101: 00010000:00010000:3.0:1789265384.466086:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265384.466099:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d38c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d38be expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.466122:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d38c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d38be expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.466144:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d38c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d38be expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.466153:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fd800, rc 0) 00000100:00100000:3.0:1789265384.466191:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+16:9510:x1876180578899456:12345-0@lo:101: Request processed in 120us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265384.466197:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789265384.466243:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899456:0@lo:101: 00010000:00010000:3.0:1789265384.466257:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d38c5 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.466264:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d38c5 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265384.466351:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899584:0@lo:501: 00000100:00100000:3.0:1789265384.466375:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.466390:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265384.466405:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578899584 00000100:00100000:3.0:1789265384.466408:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578899584 00000100:00100000:3.0:1789265384.466430:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789265384.466436:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:9510:x1876180578899584:12345-0@lo:501: 00000100:00100000:3.0:1789265384.466542:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:9510:x1876180578899584:12345-0@lo:501: Request processed in 105us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265384.466549:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789265384.466578:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899584:0@lo:501: 00000100:00100000:3.0:1789265384.466602:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899712:0@lo:503: 00000100:00100000:3.0:1789265384.466644:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.466657:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265384.466670:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578899712 00000100:00100000:3.0:1789265384.466673:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578899712 00000100:00100000:3.0:1789265384.466693:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789265384.466699:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:9510:x1876180578899712:12345-0@lo:503: 00000100:00100000:3.0:1789265384.466775:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:9510:x1876180578899712:12345-0@lo:503: Request processed in 76us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265384.466781:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789265384.466819:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899712:0@lo:503: 00000040:00080000:3.0:1789265384.467069:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265384.467131:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899840:0@lo:502: 00000100:00100000:3.0:1789265384.467162:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.467175:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265384.467188:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578899840 00000100:00100000:3.0:1789265384.467191:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578899840 00000100:00100000:3.0:1789265384.467212:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789265384.467219:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:9510:x1876180578899840:12345-0@lo:502: 00000100:00100000:3.0:1789265384.467282:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:9510:x1876180578899840:12345-0@lo:502: Request processed in 62us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265384.467288:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789265384.467319:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899840:0@lo:502: 00000040:00080000:3.0:1789265384.467500:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789265384.467522:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789265384.467538:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899968:0@lo:502: 00000100:00100000:3.0:1789265384.467565:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.467581:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265384.467592:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578899968 00000100:00100000:3.0:1789265384.467595:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578899968 00000100:00100000:3.0:1789265384.467614:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789265384.467621:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:9510:x1876180578899968:12345-0@lo:502: 00000100:00100000:3.0:1789265384.467680:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:9510:x1876180578899968:12345-0@lo:502: Request processed in 59us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265384.467686:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789265384.467719:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578899968:0@lo:502: 00000040:00080000:3.0:1789265384.467747:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789265384.467753:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789265384.471905:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265384.471921:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265384.471924:0:9525:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789265384.471934:0:9525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff937641a6a800 00000020:00000080:2.0:1789265384.471937:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265384.471951:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265384.471954:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265384.471955:0:9525:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789265384.471958:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789265384.472151:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789265384.472183:0:9510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265384.472209:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d38c5 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.472224:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d38c5 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265384.472275:0:9510:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789265384.472278:0:9510:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff937641a6a800 10000000:01000000:3.0:1789265384.472281:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff937641a6a800 10000000:01000000:3.0:1789265384.472286:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265384.472292:0:9510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff937641a6a800 from 1 10000000:01000000:3.0:1789265384.472295:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265384.472330:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.472340:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.472365:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265384.472389:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578900096:0@lo:101: 00000100:00100000:3.0:1789265384.472459:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265384.472593:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578900096 00000100:00100000:1.0:1789265384.472601:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578900096 00000100:00100000:1.0:1789265384.472663:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789265384.472672:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:9510:x1876180578900096:12345-0@lo:101: 00010000:00010000:1.0:1789265384.472685:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265384.472698:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d38d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d38cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.472720:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d38d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d38cc expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.472731:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d38d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d38cc expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.472740:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bda00, rc 0) 00000100:00100000:1.0:1789265384.473117:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:9510:x1876180578900096:12345-0@lo:101: Request processed in 445us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.473124:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789265384.473693:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265384.473721:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578900096:0@lo:101: 00010000:00010000:3.0:1789265384.473738:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d38d3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.473748:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d38d3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265384.473847:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578900224:0@lo:501: 00000100:00100000:3.0:1789265384.473917:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.473933:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789265384.474010:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578900224 00000100:00100000:0.0:1789265384.474016:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578900224 00000100:00100000:0.0:1789265384.474050:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789265384.474059:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:9510:x1876180578900224:12345-0@lo:501: 00000100:00100000:0.0:1789265384.474170:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:9510:x1876180578900224:12345-0@lo:501: Request processed in 113us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265384.474177:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789265384.474255:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578900224:0@lo:501: 00000100:00100000:1.0:1789265384.474284:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578900352:0@lo:503: 00000100:00100000:1.0:1789265384.475304:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265384.475380:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760051540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265384.478227:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578900352 00000100:00100000:3.0:1789265384.478239:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578900352 00000100:00100000:3.0:1789265384.478296:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789265384.478305:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:9510:x1876180578900352:12345-0@lo:503: 00000100:00100000:3.0:1789265384.478462:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:9510:x1876180578900352:12345-0@lo:503: Request processed in 157us (3161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265384.478469:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789265384.478905:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578900352:0@lo:503: 00000040:00080000:2.0:1789265384.479176:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265384.479254:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578900480:0@lo:502: 00000100:00100000:2.0:1789265384.479309:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265384.479351:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff937756f0dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265384.479420:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578900480 00000100:00100000:1.0:1789265384.479425:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578900480 00000100:00100000:1.0:1789265384.479465:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789265384.479473:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:9510:x1876180578900480:12345-0@lo:502: 00000100:00100000:1.0:1789265384.479584:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:9510:x1876180578900480:12345-0@lo:502: Request processed in 111us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.479592:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789265384.479950:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578900480:0@lo:502: 00000040:00080000:2.0:1789265384.480155:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789265384.480180:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789265384.480193:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789265384.480206:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789265384.480220:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789265384.480235:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789265384.480248:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789265384.480260:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789265384.480272:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789265384.480284:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789265384.480295:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789265384.480307:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789265384.480318:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789265384.480330:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789265384.480342:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789265384.480354:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789265384.480365:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789265384.480376:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789265384.480387:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789265384.480398:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789265384.480425:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789265384.480437:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789265384.480449:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789265384.480461:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789265384.480473:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789265384.481118:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789265384.481139:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789265384.481153:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789265384.481167:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789265384.481183:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789265384.481195:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789265384.481208:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789265384.481233:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789265384.481247:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789265384.481260:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789265384.481274:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789265384.481288:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1789265384.481315:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789265384.481329:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1789265384.481342:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1789265384.481354:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1789265384.481365:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1789265384.481377:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1789265384.481390:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1789265384.481403:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1789265384.481417:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1789265384.481456:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578900608:0@lo:502: 00000100:00100000:2.0:1789265384.481606:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265384.481755:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265384.482019:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578900608 00000100:00100000:1.0:1789265384.482032:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578900608 00000100:00100000:1.0:1789265384.482121:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789265384.482130:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:9510:x1876180578900608:12345-0@lo:502: 00000100:00100000:1.0:1789265384.482252:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:9510:x1876180578900608:12345-0@lo:502: Request processed in 123us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.482260:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789265384.482334:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578900608:0@lo:502: 00000040:00080000:2.0:1789265384.482387:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1789265384.482397:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1789265384.485289:0:9526:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789265384.485311:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93774f1899b8) 00000020:00000080:2.0:1789265384.485340:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1789265384.485454:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff937641a6a800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265384.485459:0:9526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff937641a6a800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265384.485461:0:9526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff937641a6a800 3 00010000:00080000:2.0:1789265384.485514:0:9526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9376420e7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1789265384.487154:0:9526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1789265384.487388:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789265384.487433:0:9526:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789265384.487453:0:9526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbbfdc9019c1d38e1 00000100:00080000:2.0:1789265384.487467:0:9526:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265384.487473:0:9526:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9376420e7000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1789265384.487528:0:9526:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937642665880 x1876180578900736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265384.487571:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180578900736:0@lo:38: 00000100:00100000:2.0:1789265384.487644:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265384.487714:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578900736 00000100:00100000:2.0:1789265384.487721:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578900736 00000100:00100000:2.0:1789265384.487753:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265384.487761:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876180578900736:12345-0@lo:38: 00010000:00080000:2.0:1789265384.487781:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:2.0:1789265384.487808:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbbfdc9019c1d38e8 00000004:00100000:2.0:1789265384.487822:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789265384.487848:0:6519:0:(import.c:65:import_set_state_nolock()) ffff93764278c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265384.487920:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180578900736:12345-0@lo:38: Request processed in 159us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265384.487927:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789265384.487963:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642665880 x1876180578900736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265384.487972:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265384.487979:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789265384.487985:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789265384.487989:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789265384.487991:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376420e7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789265384.487997:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180578900736:0@lo:38: 00000100:00080000:2.0:1789265384.488023:0:9526:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:0.0:1789265384.491371:0:9526:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789265384.491407:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9376433a99b8) 00000020:00000080:0.0:1789265384.491438:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1789265384.491538:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff937641a6a800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789265384.491548:0:9526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff937641a6a800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789265384.491551:0:9526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff937641a6a800 3 00010000:00080000:0.0:1789265384.491590:0:9526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9376424d0000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.142@tcp at head 00000100:00100000:1.0:1789265384.491830:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578900864:0@lo:400: 00000100:00100000:1.0:1789265384.491917:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265384.491953:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578901376:0@lo:400: 00000100:00100000:1.0:1789265384.491978:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265384.492000:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789265384.492006:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578901248:0@lo:400: 00000100:00100000:1.0:1789265384.492029:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265384.492046:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578901760:0@lo:400: 00000100:00100000:1.0:1789265384.492072:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265384.492102:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578900992:0@lo:400: 00000100:00100000:1.0:1789265384.492126:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265384.492142:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578901504:0@lo:400: 00000100:00100000:1.0:1789265384.492162:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265384.492179:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789265384.492185:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578901120:0@lo:400: 00000100:00100000:1.0:1789265384.492206:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265384.492216:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578901632:0@lo:400: 00000100:00100000:1.0:1789265384.492234:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265384.492266:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578900864 00000100:00100000:1.0:1789265384.492273:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578900864 00000100:00100000:1.0:1789265384.492314:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578901376 00000100:00100000:1.0:1789265384.492317:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578901376 00000100:00100000:1.0:1789265384.492340:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578901504 00000100:00100000:1.0:1789265384.492343:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578901504 00000100:00100000:1.0:1789265384.492354:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578901120 00000100:00100000:1.0:1789265384.492356:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578901120 00000100:00100000:1.0:1789265384.492368:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265384.492376:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578900864:12345-0@lo:400: 00000100:00100000:1.0:1789265384.492426:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578900864:12345-0@lo:400: Request processed in 50us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.492434:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265384.492450:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265384.492456:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578901376:12345-0@lo:400: 00000100:00100000:1.0:1789265384.492482:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578901376:12345-0@lo:400: Request processed in 27us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.492504:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265384.492515:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265384.492521:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578901504:12345-0@lo:400: 00000100:00100000:1.0:1789265384.492550:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578901504:12345-0@lo:400: Request processed in 30us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.492556:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265384.492567:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265384.492573:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578901120:12345-0@lo:400: 00000100:00100000:1.0:1789265384.492597:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578901120:12345-0@lo:400: Request processed in 24us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.492603:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265384.492620:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578901248 00000100:00100000:1.0:1789265384.494129:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578901248 00000100:00100000:1.0:1789265384.494173:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578900992 00000100:00100000:1.0:1789265384.494176:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578900992 00000100:00100000:1.0:1789265384.494191:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265384.494198:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578901248:12345-0@lo:400: 00000100:00100000:1.0:1789265384.494277:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578901248:12345-0@lo:400: Request processed in 79us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.494285:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265384.494302:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265384.494307:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578900992:12345-0@lo:400: 00000100:00100000:1.0:1789265384.494331:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578900992:12345-0@lo:400: Request processed in 24us (2204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.494336:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265384.494361:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578901760 00000100:00100000:1.0:1789265384.494364:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578901760 00000100:00100000:1.0:1789265384.494394:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578901632 00000100:00100000:1.0:1789265384.494397:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578901632 00000100:00100000:1.0:1789265384.494410:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265384.494415:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578901760:12345-0@lo:400: 00000100:00100000:1.0:1789265384.494440:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578901760:12345-0@lo:400: Request processed in 25us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.494445:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265384.494454:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265384.494459:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578901632:12345-0@lo:400: 00000100:00100000:1.0:1789265384.494479:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578901632:12345-0@lo:400: Request processed in 20us (2245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.494497:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789265384.494522:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265384.494531:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265384.494534:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265384.494567:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578901248:0@lo:400: 00010000:00080000:1.0:1789265384.494582:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642753480 x1876180578901760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265384.494593:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578901760:0@lo:400: 00010000:00080000:1.0:1789265384.494606:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642750a80 x1876180578900864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265384.494615:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578900864:0@lo:400: 00010000:00080000:1.0:1789265384.494686:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642751f80 x1876180578901376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265384.494696:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578901376:0@lo:400: 00010000:00080000:1.0:1789265384.494743:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642751180 x1876180578901120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265384.494753:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578901120:0@lo:400: 00010000:00080000:1.0:1789265384.494762:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642750380 x1876180578901632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265384.494771:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578901632:0@lo:400: 00000100:00100000:1.0:1789265384.494780:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578900992:0@lo:400: 00010000:00080000:1.0:1789265384.494791:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937642752a00 x1876180578901504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265384.494799:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578901504:0@lo:400: 00000100:00100000:3.0:1789265384.502205:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9527:1876180578901888:0@lo:901: 00000100:00100000:3.0:1789265384.502294:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.502364:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578901888 00000100:00100000:3.0:1789265384.502376:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578901888 00000100:00100000:3.0:1789265384.502433:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265384.502442:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9527:x1876180578901888:12345-0@lo:901: 00000100:00100000:3.0:1789265384.502547:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9527:x1876180578901888:12345-0@lo:901: Request processed in 106us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265384.502555:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789265384.502581:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265384.502605:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377461bb3c0 going to sleep for 11 seconds 00010000:00080000:3.0:1789265384.502639:0:9527:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f158700 x1876180578901888/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789265400 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265384.502653:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9527:1876180578901888:0@lo:901: 00010000:00010000:0.0:1789265384.502990:0:9526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1789265384.503185:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789265384.503239:0:9526:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789265384.503252:0:9526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xbbfdc9019c1d38f6 00000100:00080000:0.0:1789265384.503260:0:9526:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265384.503264:0:9526:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9376424d0000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265384.503286:0:9526:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937779e57100 x1876180578902016/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265384.503385:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180578902016:0@lo:38: 00000100:00100000:0.0:1789265384.503429:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789265384.503481:0:9526:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1789265384.505277:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1789265384.505510:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1789265384.505541:0:9510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265384.505568:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d38d3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265384.505581:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d38d3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789265384.505638:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789265384.505641:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789265384.505643:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265384.505644:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265384.505645:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265384.505647:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265384.505648:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265384.505650:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265384.505652:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265384.505659:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265384.505660:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265384.505664:0:9510:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789265384.505666:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265384.505667:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789265384.505668:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265384.505669:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265384.505670:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265384.505671:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265384.505672:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265384.505673:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265384.505674:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265384.505675:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265384.505676:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265384.505704:0:9510:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789265384.505730:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578902144:0@lo:253: 00000100:00100000:0.0:1789265384.505802:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265384.505846:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9376431c0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265384.506109:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578902144 00000100:00100000:2.0:1789265384.506117:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578902144 00000100:00100000:2.0:1789265384.506161:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789265384.506170:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:9510:x1876180578902144:12345-0@lo:253: 20000000:01000000:2.0:1789265384.506210:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789265384.506225:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789265384.506581:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578902016 00000100:00100000:1.0:1789265384.506592:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578902016 00000100:00100000:1.0:1789265384.506821:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265384.506827:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876180578902016:12345-0@lo:38: 00010000:00080000:1.0:1789265384.506851:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:1.0:1789265384.506907:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xbbfdc9019c1d38fd 00000004:00100000:1.0:1789265384.506924:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789265384.506956:0:6521:0:(import.c:65:import_set_state_nolock()) ffff93764276d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265384.507032:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180578902016:12345-0@lo:38: Request processed in 203us (3601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265384.507039:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789265384.507104:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937779e57100 x1876180578902016/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265384.507116:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265384.507124:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789265384.507131:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789265384.507135:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789265384.507137:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376424d0000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789265384.507143:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180578902016:0@lo:38: 20000000:01000000:2.0:1789265384.513474:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789265384.513609:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789265384.514127:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:9510:x1876180578902144:12345-0@lo:253: Request processed in 7953us (8320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265384.514141:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789265384.514342:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:50e161d8-da73-42e3-8b96-d311cd2235de:9510:1876180578902144:0@lo:253: 10000000:01000000:0.0:1789265384.514355:0:9510:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789265384.514359:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265384.514360:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789265384.514362:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265384.514363:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265384.514364:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265384.514366:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265384.514368:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265384.514369:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789265384.514370:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789265384.514372:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265384.514373:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789265384.514389:0:9510:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789265384.514664:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789265384.514670:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789265384.514692:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.514707:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d37fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d37f3 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.514715:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937740031800/0xbbfdc9019c1d3840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3839 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.514735:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.514768:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937740031800/0xbbfdc9019c1d3840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3839 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.514783:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937740031800/0xbbfdc9019c1d3840 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3839 expref: 16 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.514796:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876180578902272:0@lo:104: 00000100:00100000:1.0:1789265384.514837:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265384.514903:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d37fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d37f3 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.514911:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d37fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d37f3 expref: 16 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.514919:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642750380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876180578902400:0@lo:104: 00000100:00100000:1.0:1789265384.514940:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265384.514958:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760051900 going to sleep for 11 seconds 00000100:00100000:3.0:1789265384.515096:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578902272 00000100:00100000:3.0:1789265384.515103:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578902272 00000100:00100000:3.0:1789265384.515137:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578902400 00000100:00100000:3.0:1789265384.515140:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578902400 00000100:00100000:3.0:1789265384.515155:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265384.515163:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642751500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+4:6535:x1876180578902272:12345-0@lo:104: 00010000:00010000:3.0:1789265384.515175:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3840 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.515250:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265384.515257:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642751500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+4:6535:x1876180578902272:12345-0@lo:104: Request processed in 94us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265384.515263:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265384.515279:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265384.515285:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642751180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+3:6535:x1876180578902400:12345-0@lo:104: 00010000:00010000:3.0:1789265384.515292:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d37fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.515335:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789265384.515340:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642751180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+3:6535:x1876180578902400:12345-0@lo:104: Request processed in 56us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265384.515346:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789265384.515363:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265384.515368:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3840 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.515376:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031000 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:3.0:1789265384.515379:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3840 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.515387:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3840 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265384.515394:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3840 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265384.515399:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265384.515426:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3840 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.515433:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265384.515450:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3840 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.515458:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937740031000/0xbbfdc9019c1d3839 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3840 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.515497:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265384.515500:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d37fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.515505:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167fa00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:3.0:1789265384.515508:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d37fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.515515:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d37fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265384.515522:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d37fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265384.515527:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265384.515541:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d37fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.515547:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265384.515563:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d37fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.515570:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d37f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d37fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.515584:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265384.515586:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265384.515587:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265384.515594:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265384.515620:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578902528:0@lo:103: 00000100:00100000:3.0:1789265384.515826:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.515897:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578902656:0@lo:103: 00000100:00100000:3.0:1789265384.515922:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265384.515964:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578902528 00000100:00100000:3.0:1789265384.515969:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578902528 00010000:00010000:3.0:1789265384.515989:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937740031800/0xbbfdc9019c1d3840 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3839 expref: 17 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265384.516009:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578902656 00000100:00100000:3.0:1789265384.516012:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578902656 00010000:00010000:3.0:1789265384.516023:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d37fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d37f3 expref: 18 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265384.516042:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265384.516049:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+18:3644:x1876180578902528:12345-0@lo:103: 00010000:00010000:3.0:1789265384.516060:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265384.516065:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937740031800/0xbbfdc9019c1d3840 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3839 expref: 18 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.516075:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937740031800/0xbbfdc9019c1d3840 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3839 expref: 18 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.516090:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265384.516118:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+18:3644:x1876180578902528:12345-0@lo:103: Request processed in 70us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265384.516124:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265384.516138:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265384.516144:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+17:3645:x1876180578902656:12345-0@lo:103: 00010000:00010000:3.0:1789265384.516162:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265384.516167:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d37fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d37f3 expref: 17 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.516176:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d37fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d37f3 expref: 17 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.516187:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.516208:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789265384.516223:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008310862s 00010000:00010000:3.0:1789265384.516228:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.516235:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.516241:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.516247:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.516253:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd800 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265384.516257:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.516264:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.516280:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265384.516290:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265384.516318:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+17:3645:x1876180578902656:12345-0@lo:103: Request processed in 174us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265384.516324:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265384.516361:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578902656:0@lo:103: 00000100:00100000:3.0:1789265384.516383:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578902528:0@lo:103: 00010000:00010000:1.0:1789265384.516693:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937740031800/0xbbfdc9019c1d3840 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3839 expref: 16 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.516709:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876180578902272:0@lo:104: 00010000:00010000:1.0:1789265384.516722:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d37fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d37f3 expref: 15 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265384.516731:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642750380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876180578902400:0@lo:104: 00010000:00010000:1.0:1789265384.516757:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.516766:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.516772:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265384.516779:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3904 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789265384.528448:0:9510:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789265384.528841:0:9510:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789265384.529120:0:9510:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789265384.529672:0:9510:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789265384.529910:0:9510:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789265384.530139:0:9510:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789265384.531444:0:9510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789265384.544849:0:9510:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789265384.544885:0:9510:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789265384.544922:0:9510:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789265384.544973:0:9510:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789265384.544993:0:9510:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789265384.545011:0:9510:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789265384.546855:0:9510:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265384.547079:0:9510:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789265385.014044:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789265385.545314:0:9582:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265385.545600:0:9582:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789265385.971137:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265385.971169:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578902784:0@lo:41: 00000100:00100000:0.0:1789265385.971235:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265385.971789:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578902784 00000100:00100000:2.0:1789265385.971798:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578902784 00000100:00100000:2.0:1789265385.972497:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789265385.972511:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578902784:12345-0@lo:41: 00000004:00000024:2.0:1789265385.972548:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789265385.972615:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578902784:12345-0@lo:41: Request processed in 108us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265385.972622:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265385.972682:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578902912:0@lo:41: 00000100:00100000:1.0:1789265385.972718:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265385.972783:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578902784:0@lo:41: 00000100:00100000:3.0:1789265385.983127:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578902912 00000100:00100000:3.0:1789265385.983144:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578902912 00000100:00100000:3.0:1789265385.983218:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265385.983227:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578902912:12345-0@lo:41: 00000004:00000024:3.0:1789265385.983272:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789265385.983365:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578902912:12345-0@lo:41: Request processed in 140us (10647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265385.983370:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265385.983602:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578902912:0@lo:41: 00010000:00010000:3.0:1789265386.035348:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265386.488831:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578903040:0@lo:13: 00000100:00100000:0.0:1789265386.488922:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265386.488996:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578903040 00000100:00100000:0.0:1789265386.489004:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578903040 00000100:00100000:0.0:1789265386.489058:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265386.489067:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578903040:12345-0@lo:13: 00002000:00000024:0.0:1789265386.489098:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265386.489149:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578903040:12345-0@lo:13: Request processed in 83us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265386.489157:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789265386.489178:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265386.489209:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937779e54000 x1876180578903040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265386.489227:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578903040:0@lo:13: 00000100:00100000:2.0:1789265386.496703:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265386.496756:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578903168:0@lo:13: 00000100:00100000:2.0:1789265386.496836:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265386.496922:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578903168 00000100:00100000:2.0:1789265386.496932:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578903168 00000100:00100000:2.0:1789265386.496994:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265386.497004:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578903168:12345-0@lo:13: 00002000:00000024:2.0:1789265386.497024:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265386.497074:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578903168:12345-0@lo:13: Request processed in 72us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265386.497081:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789265386.497100:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265386.497132:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642665880 x1876180578903168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265386.497150:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578903168:0@lo:13: 00010000:00010000:3.0:1789265387.060036:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265388.083428:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265389.107773:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265389.555942:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578903296:0@lo:400: 00000100:00100000:3.0:1789265389.556032:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.556081:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578903808:0@lo:400: 00000100:00100000:3.0:1789265389.556108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.556129:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578904320:0@lo:400: 00000100:00100000:3.0:1789265389.556185:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.556213:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789265389.556220:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578903680:0@lo:400: 00000100:00100000:3.0:1789265389.556250:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.556265:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578904192:0@lo:400: 00000100:00100000:3.0:1789265389.556286:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.556317:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578903424:0@lo:400: 00000100:00100000:3.0:1789265389.556340:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.556354:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180578903936:0@lo:400: 00000100:00100000:3.0:1789265389.556373:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.556387:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180578904448:0@lo:400: 00000100:00100000:3.0:1789265389.556420:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.556434:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789265389.556451:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578903552:0@lo:400: 00000100:00100000:3.0:1789265389.556474:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.556493:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578904064:0@lo:400: 00000100:00100000:3.0:1789265389.556515:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.556526:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578904576:0@lo:400: 00000100:00100000:3.0:1789265389.556547:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.556575:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578903808 00000100:00100000:3.0:1789265389.556581:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578903808 00000100:00100000:3.0:1789265389.556620:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578903552 00000100:00100000:3.0:1789265389.556624:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578903552 00000100:00100000:3.0:1789265389.556638:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789265389.556646:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578903808:12345-0@lo:400: 00000100:00100000:3.0:1789265389.556701:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578903808:12345-0@lo:400: Request processed in 55us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.556714:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789265389.556731:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789265389.556736:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578903552:12345-0@lo:400: 00000100:00100000:3.0:1789265389.556769:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578903552:12345-0@lo:400: Request processed in 32us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.556775:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789265389.556792:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578903680 00000100:00100000:3.0:1789265389.556795:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578903680 00000100:00100000:3.0:1789265389.556811:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578903424 00000100:00100000:3.0:1789265389.556814:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578903424 00000100:00100000:3.0:1789265389.556823:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578903936 00000100:00100000:3.0:1789265389.556825:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578903936 00000100:00100000:3.0:1789265389.556846:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578904448 00000100:00100000:3.0:1789265389.556848:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578904448 00000100:00100000:3.0:1789265389.556886:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578904064 00000100:00100000:3.0:1789265389.556890:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578904064 00000100:00100000:3.0:1789265389.556905:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578904576 00000100:00100000:3.0:1789265389.556907:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578904576 00000100:00100000:3.0:1789265389.556921:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265389.556927:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578903680:12345-0@lo:400: 00000100:00100000:3.0:1789265389.556957:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578903680:12345-0@lo:400: Request processed in 30us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.556963:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265389.556976:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265389.556981:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578903424:12345-0@lo:400: 00000100:00100000:3.0:1789265389.557007:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578903424:12345-0@lo:400: Request processed in 26us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.557013:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265389.557031:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789265389.557037:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180578903936:12345-0@lo:400: 00000100:00100000:3.0:1789265389.557066:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180578903936:12345-0@lo:400: Request processed in 30us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.557072:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789265389.557082:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789265389.557087:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180578904448:12345-0@lo:400: 00000100:00100000:3.0:1789265389.557111:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180578904448:12345-0@lo:400: Request processed in 25us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.557117:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789265389.557127:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265389.557133:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578904064:12345-0@lo:400: 00000100:00100000:3.0:1789265389.557158:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578904064:12345-0@lo:400: Request processed in 25us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.557163:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265389.557174:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789265389.557180:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578904576:12345-0@lo:400: 00000100:00100000:3.0:1789265389.557206:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578904576:12345-0@lo:400: Request processed in 26us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.557211:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1789265389.557232:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265389.557236:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265389.557265:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578903552:0@lo:400: 00010000:00080000:3.0:1789265389.557279:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f15b100 x1876180578904064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265389.557290:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578904064:0@lo:400: 00010000:00080000:3.0:1789265389.557309:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775285d500 x1876180578904576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265389.557317:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578904576:0@lo:400: 00010000:00080000:3.0:1789265389.557328:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f158380 x1876180578903424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265389.557336:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578903424:0@lo:400: 00010000:00080000:3.0:1789265389.557345:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f15a300 x1876180578903936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265389.557353:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180578903936:0@lo:400: 00010000:00080000:3.0:1789265389.557363:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775285c700 x1876180578904448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265389.557372:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180578904448:0@lo:400: 00010000:00080000:3.0:1789265389.557412:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f158000 x1876180578903680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265389.557422:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578903680:0@lo:400: 00000100:00100000:3.0:1789265389.557433:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578903808:0@lo:400: 10000000:01000000:1.0:1789265389.557642:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789265389.557646:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93777aaec000 from 39 10000000:01000000:1.0:1789265389.557650:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789265389.557684:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.557695:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.557707:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265389.557725:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578904704:0@lo:101: 00000100:00100000:1.0:1789265389.557760:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265389.557799:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265389.557822:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578903296 00000100:00100000:1.0:1789265389.557827:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578903296 00000100:00100000:1.0:1789265389.557881:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578904704 00000100:00100000:1.0:1789265389.557885:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578904704 00000100:00100000:1.0:1789265389.557900:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789265389.557906:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:3646:x1876180578903296:12345-0@lo:400: 00000100:00100000:1.0:1789265389.557946:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:3646:x1876180578903296:12345-0@lo:400: Request processed in 39us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.557952:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789265389.557987:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789265389.557994:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:6516:x1876180578904704:12345-0@lo:101: 00010000:00010000:1.0:1789265389.558001:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265389.558013:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bde00/0xbbfdc9019c1d3912 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d390b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.558034:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bde00/0xbbfdc9019c1d3912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d390b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.558044:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bde00/0xbbfdc9019c1d3912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d390b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.558053:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bde00, rc 0) 00000100:00100000:1.0:1789265389.558081:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578904704:12345-0@lo:101: Request processed in 88us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.558086:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789265389.558114:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578904320 00000100:00100000:1.0:1789265389.558118:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578904320 00000100:00100000:1.0:1789265389.558148:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578904192 00000100:00100000:1.0:1789265389.558151:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578904192 00000100:00100000:1.0:1789265389.558177:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265389.558183:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578904320:12345-0@lo:400: 00000100:00100000:1.0:1789265389.558213:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578904320:12345-0@lo:400: Request processed in 30us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.558219:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265389.558230:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265389.558236:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578904192:12345-0@lo:400: 00000100:00100000:1.0:1789265389.558262:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578904192:12345-0@lo:400: Request processed in 26us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.558268:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789265389.558298:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265389.558316:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578904704:0@lo:101: 00010000:00010000:1.0:1789265389.558329:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3912 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.558337:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3912 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265389.558392:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578904832:0@lo:501: 00000100:00100000:1.0:1789265389.558415:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265389.558434:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265389.558460:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578904832 00000100:00100000:1.0:1789265389.558463:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578904832 00000100:00100000:1.0:1789265389.558483:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789265389.558487:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578904832:12345-0@lo:501: 00000100:00100000:1.0:1789265389.558593:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578904832:12345-0@lo:501: Request processed in 105us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.558608:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789265389.558638:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578904832:0@lo:501: 00000100:00100000:1.0:1789265389.558660:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578904960:0@lo:503: 00000100:00100000:1.0:1789265389.558698:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265389.558711:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4d240 going to sleep for 11 seconds 00010000:00080000:1.0:1789265389.558734:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f159f80 x1876180578904192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265389.558744:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578904192:0@lo:400: 00000100:00100000:1.0:1789265389.558753:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578903296:0@lo:400: 00010000:00080000:1.0:1789265389.558764:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775285ca80 x1876180578904320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265389.558772:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578904320:0@lo:400: 00000100:00100000:1.0:1789265389.558796:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578904960 00000100:00100000:1.0:1789265389.558799:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578904960 00000100:00100000:1.0:1789265389.558819:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789265389.558825:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578904960:12345-0@lo:503: 00000100:00100000:1.0:1789265389.558932:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578904960:12345-0@lo:503: Request processed in 106us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.558938:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789265389.558977:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578904960:0@lo:503: 00000100:00100000:3.0:1789265389.570454:0:9776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9776:1876180578905088:0@lo:502: 00000100:00100000:3.0:1789265389.570541:0:9776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.570578:0:9776:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265389.570710:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578905088 00000100:00100000:1.0:1789265389.570718:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578905088 00000100:00100000:1.0:1789265389.570775:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789265389.570785:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:9776:x1876180578905088:12345-0@lo:502: 00000100:00100000:1.0:1789265389.570950:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:9776:x1876180578905088:12345-0@lo:502: Request processed in 166us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.570958:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789265389.571167:0:9776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9776:1876180578905088:0@lo:502: 00000100:00100000:3.0:1789265389.571219:0:9776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9776:1876180578905216:0@lo:502: 00000100:00100000:3.0:1789265389.571251:0:9776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.571299:0:9776:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265389.571355:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578905216 00000100:00100000:1.0:1789265389.571360:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578905216 00000100:00100000:1.0:1789265389.571397:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789265389.571403:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+16:9776:x1876180578905216:12345-0@lo:502: 00000100:00100000:1.0:1789265389.571495:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+16:9776:x1876180578905216:12345-0@lo:502: Request processed in 92us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.571501:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789265389.571724:0:9776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9776:1876180578905216:0@lo:502: 00000040:00080000:3.0:1789265389.571744:0:9776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789265389.571996:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789265389.572022:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265389.572033:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3912 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.572045:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3912 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265389.572054:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789265389.572057:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789265389.572060:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265389.572086:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.572093:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.572102:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265389.572127:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578905344:0@lo:101: 00000100:00100000:1.0:1789265389.572159:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265389.572190:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265389.572245:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578905344 00000100:00100000:2.0:1789265389.572250:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578905344 00000100:00100000:2.0:1789265389.572294:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789265389.572302:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578905344:12345-0@lo:101: 00010000:00010000:2.0:1789265389.572312:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265389.572325:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93774167e200/0xbbfdc9019c1d3920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3919 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.572349:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93774167e200/0xbbfdc9019c1d3920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3919 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.572359:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93774167e200/0xbbfdc9019c1d3920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3919 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.572378:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93774167e200, rc 0) 00000100:00100000:2.0:1789265389.572424:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578905344:12345-0@lo:101: Request processed in 122us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.572445:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789265389.572572:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578905344:0@lo:101: 00010000:00010000:3.0:1789265389.572586:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3920 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.572595:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3920 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265389.572643:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578905472:0@lo:501: 00000100:00100000:3.0:1789265389.572668:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.572691:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265389.572739:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578905472 00000100:00100000:2.0:1789265389.572744:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578905472 00000100:00100000:2.0:1789265389.572774:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789265389.572780:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578905472:12345-0@lo:501: 00000100:00100000:2.0:1789265389.572921:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578905472:12345-0@lo:501: Request processed in 140us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.572928:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789265389.573021:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578905472:0@lo:501: 00000100:00100000:3.0:1789265389.573047:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578905600:0@lo:503: 00000100:00100000:3.0:1789265389.573085:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.573101:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265389.573152:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578905600 00000100:00100000:1.0:1789265389.573156:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578905600 00000100:00100000:1.0:1789265389.573185:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789265389.573192:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578905600:12345-0@lo:503: 00000100:00100000:1.0:1789265389.573273:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578905600:12345-0@lo:503: Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.573280:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789265389.573364:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578905600:0@lo:503: 00000100:00100000:2.0:1789265389.580833:0:9777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9777:1876180578905728:0@lo:502: 00000100:00100000:2.0:1789265389.580948:0:9777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.583496:0:9777:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265389.584418:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578905728 00000100:00100000:1.0:1789265389.584447:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578905728 00000100:00100000:1.0:1789265389.584511:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789265389.584521:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:9777:x1876180578905728:12345-0@lo:502: 00000100:00100000:1.0:1789265389.584690:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:9777:x1876180578905728:12345-0@lo:502: Request processed in 170us (3741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.584698:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789265389.585007:0:9777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9777:1876180578905728:0@lo:502: 00000020:01000000:2.0:1789265389.585043:0:9777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265389.585054:0:9777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265389.585056:0:9777:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265389.585061:0:9777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265389.585063:0:9777:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789265389.585091:0:9777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9777:1876180578905856:0@lo:502: 00000100:00100000:2.0:1789265389.585133:0:9777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.585170:0:9777:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265389.585277:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578905856 00000100:00100000:1.0:1789265389.585281:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578905856 00000100:00100000:1.0:1789265389.585317:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789265389.585324:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:9777:x1876180578905856:12345-0@lo:502: 00000100:00100000:1.0:1789265389.585393:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:9777:x1876180578905856:12345-0@lo:502: Request processed in 69us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.585400:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789265389.585544:0:9777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9777:1876180578905856:0@lo:502: 00000020:01000000:2.0:1789265389.585561:0:9777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265389.585570:0:9777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265389.585572:0:9777:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789265389.585576:0:9777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789265389.585730:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789265389.585751:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789265389.585766:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3920 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.585777:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3920 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265389.585787:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789265389.585790:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93774e5c3000 from 39 10000000:01000000:1.0:1789265389.585792:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789265389.585815:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.585824:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.585833:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265389.585845:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578905984:0@lo:101: 00000100:00100000:1.0:1789265389.585908:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265389.585922:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265389.585979:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578905984 00000100:00100000:2.0:1789265389.585984:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578905984 00000100:00100000:2.0:1789265389.586017:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789265389.586024:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578905984:12345-0@lo:101: 00010000:00010000:2.0:1789265389.586034:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265389.586045:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93774167e400/0xbbfdc9019c1d392e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3927 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.586065:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93774167e400/0xbbfdc9019c1d392e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3927 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.586075:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93774167e400/0xbbfdc9019c1d392e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3927 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.586082:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93774167e400, rc 0) 00000100:00100000:2.0:1789265389.586125:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578905984:12345-0@lo:101: Request processed in 89us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.586132:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789265389.586160:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578905984:0@lo:101: 00010000:00010000:2.0:1789265389.586172:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d392e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.586181:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d392e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265389.586229:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578906112:0@lo:501: 00000100:00100000:2.0:1789265389.586260:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.586273:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265389.586284:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578906112 00000100:00100000:2.0:1789265389.586288:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578906112 00000100:00100000:2.0:1789265389.586308:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789265389.586313:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578906112:12345-0@lo:501: 00000100:00100000:2.0:1789265389.586411:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578906112:12345-0@lo:501: Request processed in 98us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.586417:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789265389.587070:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578906112:0@lo:501: 00000100:00100000:2.0:1789265389.587103:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578906240:0@lo:503: 00000100:00100000:2.0:1789265389.587151:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.587185:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265389.587259:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578906240 00000100:00100000:3.0:1789265389.587265:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578906240 00000100:00100000:3.0:1789265389.587297:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789265389.587306:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578906240:12345-0@lo:503: 00000100:00100000:3.0:1789265389.587399:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578906240:12345-0@lo:503: Request processed in 94us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.587406:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789265389.587644:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578906240:0@lo:503: 00000100:00100000:2.0:1789265389.587836:0:9778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9778:1876180578906368:0@lo:502: 00000100:00100000:2.0:1789265389.587892:0:9778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.587913:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578906368 00000100:00100000:2.0:1789265389.587917:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578906368 00000100:00100000:2.0:1789265389.587943:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789265389.587949:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:9778:x1876180578906368:12345-0@lo:502: 00000100:00100000:2.0:1789265389.588031:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:9778:x1876180578906368:12345-0@lo:502: Request processed in 82us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.588038:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789265389.588070:0:9778:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265389.588083:0:9778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9778:1876180578906368:0@lo:502: 00000100:00100000:2.0:1789265389.588130:0:9778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9778:1876180578906496:0@lo:502: 00000100:00100000:2.0:1789265389.588161:0:9778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.588179:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578906496 00000100:00100000:2.0:1789265389.588183:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578906496 00000100:00100000:2.0:1789265389.588201:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789265389.588207:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:9778:x1876180578906496:12345-0@lo:502: 00000100:00100000:2.0:1789265389.588264:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:9778:x1876180578906496:12345-0@lo:502: Request processed in 57us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.588270:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789265389.588295:0:9778:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265389.588306:0:9778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9778:1876180578906496:0@lo:502: 00000040:00080000:2.0:1789265389.588324:0:9778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789265389.588373:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789265389.588394:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789265389.588403:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d392e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.588413:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d392e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265389.588422:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789265389.588425:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93774e5c3000 from 6 10000000:01000000:2.0:1789265389.588428:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789265389.588608:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.588618:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.588638:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265389.588650:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578906624:0@lo:101: 00000100:00100000:2.0:1789265389.588677:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.589007:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377501a2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789265389.589559:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578906624 00000100:00100000:3.0:1789265389.589576:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578906624 00000100:00100000:3.0:1789265389.589616:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789265389.589623:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578906624:12345-0@lo:101: 00010000:00010000:3.0:1789265389.589635:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265389.589652:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377413fca00/0xbbfdc9019c1d393c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3935 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.589679:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377413fca00/0xbbfdc9019c1d393c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3935 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.589690:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377413fca00/0xbbfdc9019c1d393c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3935 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.589699:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fca00, rc 0) 00000100:00100000:3.0:1789265389.589750:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+19:6516:x1876180578906624:12345-0@lo:101: Request processed in 127us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.589756:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789265389.589802:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578906624:0@lo:101: 00010000:00010000:3.0:1789265389.589817:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.589826:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265389.589905:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578906752:0@lo:256: 00000100:00100000:3.0:1789265389.589939:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.589960:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265389.589971:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578906752 00000100:00100000:3.0:1789265389.589974:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578906752 00000100:00100000:3.0:1789265389.589999:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789265389.590006:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+19:6516:x1876180578906752:12345-0@lo:256: 20000000:01000000:3.0:1789265389.590018:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789265389.590036:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789265389.590039:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789265389.590121:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+19:6516:x1876180578906752:12345-0@lo:256: Request processed in 115us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.590127:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789265389.590156:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578906752:0@lo:256: 10000000:01000000:3.0:1789265389.590198:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789265389.590204:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.590212:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265389.590221:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789265389.590224:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1789265389.590226:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789265389.590242:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.590247:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.590253:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265389.590264:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578906880:0@lo:101: 00000100:00100000:3.0:1789265389.590297:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.590311:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265389.590321:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578906880 00000100:00100000:3.0:1789265389.590324:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578906880 00000100:00100000:3.0:1789265389.590341:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789265389.590346:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+19:6516:x1876180578906880:12345-0@lo:101: 00010000:00010000:3.0:1789265389.590352:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265389.590361:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d394a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3943 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.590375:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d394a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3943 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.590383:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d394a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3943 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.590389:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fde00, rc 0) 00000100:00100000:3.0:1789265389.590418:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578906880:12345-0@lo:101: Request processed in 71us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.590424:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789265389.590552:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578906880:0@lo:101: 00010000:00010000:3.0:1789265389.590562:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d394a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.590570:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d394a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265389.590618:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578907008:0@lo:501: 00000100:00100000:3.0:1789265389.590649:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.590662:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265389.590672:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578907008 00000100:00100000:3.0:1789265389.590676:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578907008 00000100:00100000:3.0:1789265389.590693:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789265389.590698:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578907008:12345-0@lo:501: 00000100:00100000:3.0:1789265389.590815:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578907008:12345-0@lo:501: Request processed in 116us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.590822:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789265389.590851:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578907008:0@lo:501: 00000100:00100000:3.0:1789265389.590901:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578907136:0@lo:503: 00000100:00100000:3.0:1789265389.590940:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.590960:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377611760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265389.590971:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578907136 00000100:00100000:3.0:1789265389.590974:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578907136 00000100:00100000:3.0:1789265389.590991:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789265389.590996:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578907136:12345-0@lo:503: 00000100:00100000:3.0:1789265389.591069:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578907136:12345-0@lo:503: Request processed in 72us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.591076:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789265389.591114:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578907136:0@lo:503: 00000100:00100000:3.0:1789265389.591300:0:9779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9779:1876180578907264:0@lo:502: 00000100:00100000:3.0:1789265389.591332:0:9779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.591350:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578907264 00000100:00100000:3.0:1789265389.591353:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578907264 00000100:00100000:3.0:1789265389.591375:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789265389.591388:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:9779:x1876180578907264:12345-0@lo:502: 00000100:00100000:0.0:1789265389.591597:0:9779:0:(client.c:2715:ptlrpc_set_wait()) set ffff937761176900 going to sleep for 11 seconds 00000100:00100000:3.0:1789265389.592163:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:9779:x1876180578907264:12345-0@lo:502: Request processed in 773us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.592172:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789265389.592276:0:9779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9779:1876180578907264:0@lo:502: 00000020:01000000:0.0:1789265389.592305:0:9779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789265389.592312:0:9779:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789265389.592325:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265389.592328:0:9779:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789265389.592332:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789265389.592336:0:9779:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:0.0:1789265389.592357:0:9779:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789265389.592360:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265389.592375:0:9779:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9376433a8000) 00000020:00000080:0.0:1789265389.592397:0:9779:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1789265389.592403:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789265389.592512:0:9779:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789265389.592520:0:9779:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789265389.592528:0:9779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbbfdc9019c1d3958 00010000:00080000:0.0:1789265389.592560:0:9779:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9376420e7800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:0.0:1789265389.592792:0:9779:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1789265389.592964:0:9779:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789265389.592976:0:9779:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789265389.593147:0:9779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265389.593275:0:9779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265389.593422:0:9779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789265389.593529:0:9779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789265389.594102:0:9780:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265389.594107:0:9780:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789265389.594680:0:9779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789265389.594691:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789265389.594727:0:9779:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789265389.594750:0:9779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbbfdc9019c1d395f 00000100:00080000:2.0:1789265389.594760:0:9779:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265389.594766:0:9779:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9376420e7800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1789265389.594800:0:9779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937642665c00 x1876180578907392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265389.594830:0:9779:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789265389.594919:0:9779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265389.594923:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265389.594925:0:9779:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789265389.594928:0:9779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265389.594931:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265389.594933:0:9779:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265389.594935:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265389.594937:0:9779:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789265389.594963:0:9779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642664a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9779:1876180578907520:0@lo:502: 00000100:00100000:2.0:1789265389.595041:0:9779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.595089:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578907520 00000100:00100000:2.0:1789265389.595096:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578907520 00000100:00100000:2.0:1789265389.595134:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789265389.595141:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+20:9779:x1876180578907520:12345-0@lo:502: 00000100:00100000:2.0:1789265389.595253:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+20:9779:x1876180578907520:12345-0@lo:502: Request processed in 110us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.595261:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789265389.595311:0:9779:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265389.595331:0:9779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642664a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9779:1876180578907520:0@lo:502: 00000020:01000000:2.0:1789265389.595354:0:9779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265389.595358:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265389.595360:0:9779:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789265389.595364:0:9779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1789265389.595654:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1789265389.595677:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789265389.595689:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d394a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.595701:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d394a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265389.595710:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789265389.595713:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff937779e62800 from 39 10000000:01000000:3.0:1789265389.595716:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265389.595757:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.595765:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.595774:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265389.595788:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578907648:0@lo:101: 00000100:00100000:3.0:1789265389.595821:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.595853:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93777a3ed600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265389.596643:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578907648 00000100:00100000:2.0:1789265389.596652:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578907648 00000100:00100000:2.0:1789265389.596711:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789265389.596719:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578907648:12345-0@lo:101: 00010000:00010000:2.0:1789265389.596733:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265389.596750:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93774167f000/0xbbfdc9019c1d396d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3966 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.596775:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93774167f000/0xbbfdc9019c1d396d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3966 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.596785:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93774167f000/0xbbfdc9019c1d396d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3966 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.596793:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93774167f000, rc 0) 00000100:00100000:2.0:1789265389.596875:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578907648:12345-0@lo:101: Request processed in 137us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.596892:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789265389.597597:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578907648:0@lo:101: 00010000:00010000:3.0:1789265389.597617:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d396d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.597636:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d396d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265389.597712:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578907776:0@lo:501: 00000100:00100000:3.0:1789265389.597750:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.597793:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93777a3ed600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265389.597850:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578907776 00000100:00100000:2.0:1789265389.597855:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578907776 00000100:00100000:2.0:1789265389.597918:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789265389.597926:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578907776:12345-0@lo:501: 00000100:00100000:2.0:1789265389.598047:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578907776:12345-0@lo:501: Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.598054:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789265389.598156:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180578907392:0@lo:8: 00000100:00100000:1.0:1789265389.598191:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.600932:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578907392 00000100:00100000:2.0:1789265389.600949:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578907392 00000100:00100000:2.0:1789265389.601002:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265389.601010:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642750a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1876180578907392:12345-0@lo:8: 00010000:00080000:2.0:1789265389.601043:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:2.0:1789265389.601090:0:8435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbbfdc9019c1d3974 00002000:00100000:2.0:1789265389.601108:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff93764278a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789265389.601113:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1789265389.601117:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789265389.601189:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789265389.603650:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578907776:0@lo:501: 00000100:00100000:3.0:1789265389.603733:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578907904:0@lo:503: 00000100:00100000:3.0:1789265389.603825:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.603900:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93777a3ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265389.603923:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578907904 00000100:00100000:3.0:1789265389.603931:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578907904 00000100:00100000:3.0:1789265389.603984:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789265389.603992:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578907904:12345-0@lo:503: 00000100:00100000:3.0:1789265389.604107:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578907904:12345-0@lo:503: Request processed in 115us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.604116:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789265389.604169:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578907904:0@lo:503: 00002000:00080000:2.0:1789265389.604320:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789265389.604349:0:8435:0:(import.c:65:import_set_state_nolock()) ffff937642788800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265389.604393:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642750a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1876180578907392:12345-0@lo:8: Request processed in 3383us (6201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.604401:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265389.607705:0:9782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9782:1876180578908032:0@lo:502: 00000100:00100000:3.0:1789265389.607793:0:9782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.607843:0:9782:0:(client.c:2715:ptlrpc_set_wait()) set ffff93777a3edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265389.607928:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578908032 00000100:00100000:2.0:1789265389.607936:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578908032 00000100:00100000:2.0:1789265389.607991:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789265389.608001:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:9782:x1876180578908032:12345-0@lo:502: 00000100:00100000:2.0:1789265389.608134:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:9782:x1876180578908032:12345-0@lo:502: Request processed in 134us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.608142:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789265389.608232:0:9782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9782:1876180578908032:0@lo:502: 00000100:00100000:3.0:1789265389.608279:0:9782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9782:1876180578908160:0@lo:502: 00000100:00100000:3.0:1789265389.608322:0:9782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.608348:0:9782:0:(client.c:2715:ptlrpc_set_wait()) set ffff93777a3edcc0 going to sleep for 11 seconds 00010000:00080000:1.0:1789265389.609396:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642665c00 x1876180578907392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265389.609409:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265389.609417:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789265389.609426:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:2.0:1789265389.609588:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578908160 00000100:00100000:2.0:1789265389.609594:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578908160 00000100:00100000:2.0:1789265389.609637:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789265389.609645:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:9782:x1876180578908160:12345-0@lo:502: 00000100:00100000:2.0:1789265389.609773:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:9782:x1876180578908160:12345-0@lo:502: Request processed in 128us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.609780:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1789265389.610130:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789265389.610142:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376420e7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789265389.610160:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789265389.610167:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180578907392:0@lo:8: 00000100:00100000:2.0:1789265389.610273:0:9781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642664a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9781:1876180578908288:0@lo:700: 00000100:00100000:2.0:1789265389.610312:0:9781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.610337:0:9781:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265389.610356:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578908288 00000100:00100000:2.0:1789265389.610361:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578908288 00000100:00100000:2.0:1789265389.610403:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265389.610410:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9781:x1876180578908288:12345-0@lo:700: 00000100:00100000:3.0:1789265389.610614:0:9782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9782:1876180578908160:0@lo:502: 00000040:00080000:3.0:1789265389.610648:0:9782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:2.0:1789265389.610948:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8443:1876180578908416:0@lo:700: 00000100:00100000:2.0:1789265389.611047:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.611110:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018540 going to sleep for 11 seconds 00000020:01000000:2.0:1789265389.611129:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789265389.611154:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789265389.611166:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d396d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.611178:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d396d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265389.611210:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789265389.611212:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff937779e62800 from 6 10000000:01000000:2.0:1789265389.611216:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789265389.611242:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.611249:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.611258:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265389.611272:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578908544:0@lo:101: 00000100:00100000:2.0:1789265389.611334:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.611358:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377479db840 going to sleep for 11 seconds 00000004:00080000:2.0:1789265389.611373:0:9780:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789265389.611536:0:9780:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 245272675355ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789265389.611543:0:9780:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:1.0:1789265389.612173:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789265389.613226:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789265389.614175:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578908544 00000100:00100000:2.0:1789265389.614188:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578908544 00000100:00100000:2.0:1789265389.614243:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789265389.614252:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578908544:12345-0@lo:101: 00010000:00010000:2.0:1789265389.614270:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265389.614290:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93774167e000/0xbbfdc9019c1d3982 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d397b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.614318:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93774167e000/0xbbfdc9019c1d3982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d397b expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.614337:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93774167e000/0xbbfdc9019c1d3982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d397b expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.614347:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93774167e000, rc 0) 00000100:00100000:2.0:1789265389.614426:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578908544:12345-0@lo:101: Request processed in 175us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.616052:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789265389.616151:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578908544:0@lo:101: 00010000:00010000:2.0:1789265389.618592:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.618616:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265389.618720:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578908672:0@lo:256: 00000100:00100000:2.0:1789265389.618797:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.618856:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937756e31000 going to sleep for 11 seconds 00000100:00100000:1.0:1789265389.619566:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578908672 00000100:00100000:1.0:1789265389.619578:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578908672 00000100:00100000:1.0:1789265389.619639:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789265389.619649:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578908672:12345-0@lo:256: 20000000:01000000:1.0:1789265389.619672:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789265389.619693:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789265389.619696:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789265389.619808:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578908672:12345-0@lo:256: Request processed in 159us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.619815:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789265389.619891:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578908672:0@lo:256: 10000000:01000000:1.0:1789265389.619948:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265389.619957:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.619969:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265389.619978:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789265389.619981:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789265389.619984:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265389.620014:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.620022:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.620039:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265389.620055:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578908800:0@lo:101: 00000100:00100000:1.0:1789265389.620086:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265389.620105:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789265389.620120:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578908800 00000100:00100000:1.0:1789265389.620124:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578908800 00000100:00100000:1.0:1789265389.620148:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789265389.620155:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578908800:12345-0@lo:101: 00010000:00010000:1.0:1789265389.620165:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265389.620176:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3990 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3989 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.620196:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3989 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.620206:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3989 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.620214:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc800, rc 0) 00000100:00100000:1.0:1789265389.620242:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578908800:12345-0@lo:101: Request processed in 87us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.620248:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789265389.620280:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578908800:0@lo:101: 00010000:00010000:1.0:1789265389.620292:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3990 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265389.620310:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3990 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265389.620367:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578908928:0@lo:501: 00000100:00100000:1.0:1789265389.620392:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265389.620406:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760051900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265389.620418:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578908928 00000100:00100000:1.0:1789265389.620421:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578908928 00000100:00100000:1.0:1789265389.620481:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789265389.620488:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578908928:12345-0@lo:501: 00000100:00100000:1.0:1789265389.620596:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578908928:12345-0@lo:501: Request processed in 107us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.620602:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789265389.620632:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578908928:0@lo:501: 00000100:00100000:1.0:1789265389.620657:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578909056:0@lo:503: 00000100:00100000:1.0:1789265389.620697:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265389.620711:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760051900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265389.620722:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578909056 00000100:00100000:1.0:1789265389.620725:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578909056 00000100:00100000:1.0:1789265389.620745:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789265389.620750:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578909056:12345-0@lo:503: 00000100:00100000:1.0:1789265389.620827:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578909056:12345-0@lo:503: Request processed in 76us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.620834:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789265389.620892:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578909056:0@lo:503: 00000100:00100000:3.0:1789265389.626073:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578908416 00000100:00100000:3.0:1789265389.626089:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578908416 00000100:00100000:3.0:1789265389.626165:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265389.626176:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8443:x1876180578908416:12345-0@lo:700: 00000100:00100000:3.0:1789265389.626542:0:9783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9783:1876180578909184:0@lo:502: 00000100:00100000:3.0:1789265389.626620:0:9783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.626665:0:9783:0:(client.c:2715:ptlrpc_set_wait()) set ffff93777a3ed300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265389.626708:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578909184 00000100:00100000:2.0:1789265389.626712:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578909184 00000100:00100000:2.0:1789265389.626748:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789265389.626755:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:9783:x1876180578909184:12345-0@lo:502: 00000100:00100000:2.0:1789265389.626934:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:9783:x1876180578909184:12345-0@lo:502: Request processed in 178us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.626942:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789265389.627541:0:9783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9783:1876180578909184:0@lo:502: 00000020:01000000:3.0:1789265389.627577:0:9783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265389.627586:0:9783:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789265389.627595:0:9783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265389.627597:0:9783:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789265389.627602:0:9783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265389.627606:0:9783:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:3.0:1789265389.627631:0:9783:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789265389.627635:0:9783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265389.627650:0:9783:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9376424f19b8) 00000020:00000080:3.0:1789265389.627676:0:9783:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789265389.627682:0:9783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265389.627769:0:9783:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789265389.627776:0:9783:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789265389.627782:0:9783:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d399e 00010000:00080000:3.0:1789265389.627813:0:9783:0:(ldlm_lib.c:102:import_set_conn()) imp ffff937642503800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1789265389.629805:0:9783:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1789265389.629996:0:9783:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789265389.630013:0:9783:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789265389.630190:0:9783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265389.630311:0:9783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265389.632752:0:9783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789265389.633732:0:9783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789265389.637790:0:9784:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265389.637797:0:9784:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789265389.638753:0:9783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265389.638766:0:9783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789265389.638803:0:9783:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789265389.638829:0:9783:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbbfdc9019c1d39a5 00000100:00080000:3.0:1789265389.638841:0:9783:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265389.638847:0:9783:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff937642503800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265389.638918:0:9783:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9376434d4e00 x1876180578909312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265389.638944:0:9783:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789265389.639003:0:9783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265389.639007:0:9783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265389.639009:0:9783:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789265389.639012:0:9783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265389.639016:0:9783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265389.639017:0:9783:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789265389.639020:0:9783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789265389.639022:0:9783:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789265389.639051:0:9783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9783:1876180578909440:0@lo:502: 00000100:00100000:3.0:1789265389.639131:0:9783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.639169:0:9783:0:(client.c:2715:ptlrpc_set_wait()) set ffff93777a3ed180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265389.639398:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578909440 00000100:00100000:1.0:1789265389.639405:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578909440 00000100:00100000:1.0:1789265389.639472:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789265389.639482:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:9783:x1876180578909440:12345-0@lo:502: 00000100:00100000:1.0:1789265389.639605:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:9783:x1876180578909440:12345-0@lo:502: Request processed in 124us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.639613:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789265389.641266:0:9783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:9783:1876180578909440:0@lo:502: 00000020:01000000:3.0:1789265389.641314:0:9783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265389.641324:0:9783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265389.641326:0:9783:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789265389.641340:0:9783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:0.0:1789265389.641549:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180578909312:0@lo:8: 00000100:00100000:0.0:1789265389.641618:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265389.641677:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578909312 00000100:00100000:0.0:1789265389.641682:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578909312 00000100:00100000:0.0:1789265389.641714:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265389.641721:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876180578909312:12345-0@lo:8: 00010000:00080000:0.0:1789265389.641750:0:8434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1789265389.641778:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbbfdc9019c1d39ac 00002000:00100000:0.0:1789265389.641792:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9376420e3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789265389.641806:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789265389.641809:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789265389.641904:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789265389.641929:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9376420e0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265389.641979:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180578909312:12345-0@lo:8: Request processed in 256us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265389.641987:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789265389.642035:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376434d4e00 x1876180578909312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265389.642045:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265389.642051:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789265389.642058:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789265389.642063:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789265389.642065:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937642503800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789265389.644313:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789265389.644329:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180578909312:0@lo:8: 00000004:00080000:1.0:1789265389.649324:0:9784:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:3.0:1789265389.653249:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1789265389.653286:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789265389.653297:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3990 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.653310:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3990 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265389.653322:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789265389.653326:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93775f68cd28 from 1 10000000:01000000:3.0:1789265389.653328:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789265389.653366:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.653375:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.653386:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265389.653412:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578909568:0@lo:101: 00000100:00100000:3.0:1789265389.653512:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.653564:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93777a3c4e40 going to sleep for 11 seconds 00000004:00080000:1.0:1789265389.653795:0:9784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 245314934766ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789265389.653804:0:9784:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789265389.656197:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578909568 00000100:00100000:2.0:1789265389.656213:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578909568 00000100:00100000:2.0:1789265389.656285:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789265389.656297:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578909568:12345-0@lo:101: 00010000:00010000:2.0:1789265389.656315:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265389.656334:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93774167f600/0xbbfdc9019c1d39ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d39b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.656365:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93774167f600/0xbbfdc9019c1d39ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d39b3 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.656376:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93774167f600/0xbbfdc9019c1d39ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d39b3 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265389.656385:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93774167f600, rc 0) 00000100:00100000:2.0:1789265389.656477:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578909568:12345-0@lo:101: Request processed in 183us (2965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.656484:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 40000000:02000000:2.0:1789265389.656757:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1789265389.658684:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578909568:0@lo:101: 00010000:00010000:3.0:1789265389.658714:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d39ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265389.658727:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d39ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265389.658832:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578909696:0@lo:501: 00000100:00100000:3.0:1789265389.658924:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.658969:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93777a3c4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265389.665585:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578909696 00000100:00100000:0.0:1789265389.665602:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578909696 00000100:00100000:0.0:1789265389.665668:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789265389.665679:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578909696:12345-0@lo:501: 00000100:00100000:0.0:1789265389.665828:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578909696:12345-0@lo:501: Request processed in 151us (6904us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265389.665837:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789265389.665913:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578909696:0@lo:501: 10000000:01000000:0.0:1789265389.665957:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789265389.665980:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d39ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265389.666006:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d39ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265389.678323:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8443:x1876180578908416:12345-0@lo:700: Request processed in 52141us (67266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.678339:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789265389.678395:0:8443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642665180 x1876180578908416/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789265405 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265389.678410:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8443:1876180578908416:0@lo:700: 40000000:02000000:2.0:1789265389.678425:0:8443:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:2.0:1789265389.695194:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789265389.695297:0:9785:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789265389.695328:0:9785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642666a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9785:1876180578909952:0@lo:7: 00000100:00100000:2.0:1789265389.695409:0:9785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.695504:0:9785:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265389.695525:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578909824:0@lo:13: 00000100:00100000:2.0:1789265389.695554:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.695589:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578909824 00000100:00100000:2.0:1789265389.695597:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578909824 00000100:00100000:2.0:1789265389.695653:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265389.695662:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876180578909824:12345-0@lo:13: 00002000:00000024:2.0:1789265389.695689:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789265389.695731:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876180578909824:12345-0@lo:13: Request processed in 69us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.695738:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789265389.695775:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642665180 x1876180578909824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265389.695792:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578909824:0@lo:13: 00000100:00100000:2.0:1789265389.696269:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578909952 00000100:00100000:2.0:1789265389.696274:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578909952 00000100:00100000:2.0:1789265389.696313:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265389.696321:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9785:x1876180578909952:12345-0@lo:7: 00000100:00080000:1.0:1789265389.698945:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1789265389.715904:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789265389.715916:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789265389.717767:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9781:x1876180578908288:12345-0@lo:700: Request processed in 107349us (107446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.717781:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789265389.717916:0:9781:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642664a80 x1876180578908288/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789265405 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265389.717932:0:9781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642664a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9781:1876180578908288:0@lo:700: 00000004:00080000:3.0:1789265389.722918:0:9781:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789265389.722953:0:9781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9781:1876180578910208:0@lo:7: 00000100:00100000:3.0:1789265389.723026:0:9781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.723080:0:9781:0:(client.c:2715:ptlrpc_set_wait()) set ffff93777a3c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265389.723099:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578910080:0@lo:13: 00000100:00100000:3.0:1789265389.723124:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.723169:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578910080 00000100:00100000:3.0:1789265389.723177:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578910080 00000100:00100000:3.0:1789265389.723221:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265389.723230:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578910080:12345-0@lo:13: 00002000:00000024:3.0:1789265389.723250:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1789265389.723295:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578910080:12345-0@lo:13: Request processed in 66us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.723302:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789265389.723342:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376434d4a80 x1876180578910080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265389.723361:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578910080:0@lo:13: 00002000:00080000:2.0:1789265389.724258:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789265389.724265:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789265389.724318:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9785:x1876180578909952:12345-0@lo:7: Request processed in 27997us (28907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.724327:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265389.724346:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578910208 00000100:00100000:2.0:1789265389.724351:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578910208 00000100:00100000:2.0:1789265389.724379:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265389.724392:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9781:x1876180578910208:12345-0@lo:7: 00010000:00080000:3.0:1789265389.728687:0:9785:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642666a00 x1876180578909952/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265405 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265389.728715:0:9785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642666a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9785:1876180578909952:0@lo:7: 00000004:00080000:3.0:1789265389.728731:0:9785:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789265389.728776:0:9785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9785:1876180578910336:0@lo:5: 00000100:00100000:3.0:1789265389.728836:0:9785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.728899:0:9785:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265389.733599:0:8435:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789265389.733623:0:8435:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789265389.734022:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578910336 00000100:00100000:1.0:1789265389.734033:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578910336 00002000:00080000:2.0:1789265389.743027:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789265389.743040:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789265389.743139:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9781:x1876180578910208:12345-0@lo:7: Request processed in 18742us (20108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265389.743151:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789265389.743211:0:9781:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376434d5500 x1876180578910208/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265405 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265389.743226:0:9781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9781:1876180578910208:0@lo:7: 00000004:00080000:2.0:1789265389.743243:0:9781:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789265389.743285:0:9781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9781:1876180578910464:0@lo:5: 00000100:00100000:2.0:1789265389.743319:0:9781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.743340:0:9781:0:(client.c:2715:ptlrpc_set_wait()) set ffff937643574600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265389.743369:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578910464 00000100:00100000:2.0:1789265389.743375:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578910464 00000100:00100000:2.0:1789265389.743413:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265389.743423:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9785:x1876180578910336:12345-0@lo:5: 00000100:00100000:3.0:1789265389.745707:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265389.745732:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9781:x1876180578910464:12345-0@lo:5: 00002000:00080000:3.0:1789265389.745767:0:9789:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789265389.745874:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9781:x1876180578910464:12345-0@lo:5: Request processed in 139us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265389.745882:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789265389.747655:0:9781:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642665180 x1876180578910464/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265405 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265389.747674:0:9781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9781:1876180578910464:0@lo:5: 00000004:00080000:2.0:1789265389.747695:0:9781:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789265389.747750:0:9781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9781:1876180578910592:0@lo:5: 00000100:00100000:2.0:1789265389.747811:0:9781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265389.747931:0:9781:0:(client.c:2715:ptlrpc_set_wait()) set ffff937643574600 going to sleep for 11 seconds 00002000:00080000:2.0:1789265389.747985:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789265389.748000:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789265389.748362:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9785:x1876180578910336:12345-0@lo:5: Request processed in 4939us (19524us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789265389.748372:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265389.748397:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578910592 00000100:00100000:2.0:1789265389.748404:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578910592 00010000:00080000:3.0:1789265389.748537:0:9785:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376434d4a80 x1876180578910336/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265405 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265389.748551:0:9785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9785:1876180578910336:0@lo:5: 00000004:00080000:3.0:1789265389.748560:0:9785:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789265389.748588:0:9785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9785:1876180578910720:0@lo:700: 00000100:00100000:3.0:1789265389.748618:0:9785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265389.748642:0:9785:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265389.754895:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578910720 00000100:00100000:3.0:1789265389.754909:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578910720 00000100:00100000:3.0:1789265389.754987:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265389.754998:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9785:x1876180578910720:12345-0@lo:700: 00000100:00100000:1.0:1789265389.755398:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265389.756244:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9781:x1876180578910592:12345-0@lo:5: 00002000:00080000:1.0:1789265389.756285:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000001:00080000:1.0:1789265389.766563:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1789265389.766694:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9785:x1876180578910720:12345-0@lo:700: Request processed in 11694us (18070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.766716:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789265389.766790:0:9785:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376434d6a00 x1876180578910720/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789265405 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265389.766802:0:9785:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789265389.766820:0:9785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9785:1876180578910720:0@lo:700: 00000100:00100000:1.0:1789265389.768011:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9781:x1876180578910592:12345-0@lo:5: Request processed in 12601us (20197us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789265389.768021:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789265389.768065:0:9781:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642665180 x1876180578910592/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265405 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265389.768080:0:9781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9781:1876180578910592:0@lo:5: 00000004:00080000:1.0:1789265389.768092:0:9781:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789265389.768135:0:9781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9781:1876180578910848:0@lo:900: 00000100:00100000:1.0:1789265389.768171:0:9781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265389.768196:0:9781:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775f6f9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265389.768217:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578910848 00000100:00100000:1.0:1789265389.768222:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578910848 00000100:00100000:1.0:1789265389.768263:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265389.768272:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9781:x1876180578910848:12345-0@lo:900: 00000100:00100000:1.0:1789265389.768317:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9781:x1876180578910848:12345-0@lo:900: Request processed in 47us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265389.768323:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789265389.768353:0:9781:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642753480 x1876180578910848/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265405 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265389.768361:0:9781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9781:1876180578910848:0@lo:900: 00000004:02000040:3.0:1789265389.770101:0:9785:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1789265389.778362:0:9785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9785:1876180578910976:0@lo:5: 00000100:00100000:1.0:1789265389.778551:0:9785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265389.778593:0:9785:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775f6f9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265389.778661:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578910976 00000100:00100000:3.0:1789265389.778679:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578910976 00000100:00100000:3.0:1789265389.778731:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265389.778740:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9785:x1876180578910976:12345-0@lo:5: 00002000:00080000:3.0:1789265389.783580:0:9789:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789265389.783601:0:9789:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1789265389.785397:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9785:x1876180578910976:12345-0@lo:5: Request processed in 6652us (6840us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789265389.785408:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789265389.788696:0:9785:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642753480 x1876180578910976/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265405 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265389.788718:0:9785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9785:1876180578910976:0@lo:5: 00000004:00080000:1.0:1789265389.788734:0:9785:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1789265390.131273:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265391.091183:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578911104:0@lo:41: 00000100:00100000:3.0:1789265391.091262:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265391.091328:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265391.091335:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578911232:0@lo:41: 00000100:00100000:3.0:1789265391.091360:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265391.091408:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578911104 00000100:00100000:3.0:1789265391.091415:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578911104 00000100:00100000:0.0:1789265391.091523:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578911232 00000100:00100000:0.0:1789265391.091527:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578911232 00000100:00100000:0.0:1789265391.091568:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789265391.091578:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578911232:12345-0@lo:41: 00000004:00000024:0.0:1789265391.091613:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265391.091669:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578911232:12345-0@lo:41: Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265391.091677:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789265391.091926:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578911232:0@lo:41: 00000100:00100000:3.0:1789265391.092364:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265391.092372:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578911104:12345-0@lo:41: 00000004:00000024:3.0:1789265391.092394:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789265391.092613:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578911104:12345-0@lo:41: Request processed in 241us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265391.092619:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789265391.096629:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578911104:0@lo:41: 00010000:00010000:0.0:1789265391.161062:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265391.604075:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578911360:0@lo:13: 00000100:00100000:3.0:1789265391.604154:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265391.604341:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578911360 00000100:00100000:2.0:1789265391.604350:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578911360 00000100:00100000:2.0:1789265391.604430:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265391.604441:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578911360:12345-0@lo:13: 00002000:00000024:2.0:1789265391.604471:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265391.604520:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578911360:12345-0@lo:13: Request processed in 82us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265391.604527:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789265391.604653:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265391.604689:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642666680 x1876180578911360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265391.604718:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578911360:0@lo:13: 00000100:00100000:2.0:1789265391.613032:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265391.613060:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578911488:0@lo:13: 00000100:00100000:2.0:1789265391.613128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265391.613188:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578911488 00000100:00100000:2.0:1789265391.613514:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578911488 00000100:00100000:2.0:1789265391.613686:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265391.613708:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578911488:12345-0@lo:13: 00002000:00000024:2.0:1789265391.613732:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265391.613784:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578911488:12345-0@lo:13: Request processed in 89us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265391.613792:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789265391.613840:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642667800 x1876180578911488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265391.613879:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578911488:0@lo:13: 00000100:00080000:3.0:1789265391.620955:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1789265391.884166:0:9883:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789265392.184692:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789265393.054005:0:9935:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265393.054727:0:9935:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265393.208922:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789265393.958628:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1789265393.958652:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1789265394.229836:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265394.675146:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578912000:0@lo:400: 00000100:00100000:3.0:1789265394.675243:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265394.675309:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578912512:0@lo:400: 00000100:00100000:0.0:1789265394.675800:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578911744:0@lo:400: 00000100:00100000:0.0:1789265394.675848:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265394.675897:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578912256:0@lo:400: 00000100:00100000:0.0:1789265394.675919:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265394.675943:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578912768:0@lo:400: 00000100:00100000:0.0:1789265394.675967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265394.675990:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1789265394.675997:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578911616:0@lo:400: 00000100:00100000:0.0:1789265394.676023:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265394.676043:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578912128:0@lo:400: 00000100:00100000:0.0:1789265394.676079:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265394.676110:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578912640:0@lo:400: 00000100:00100000:0.0:1789265394.676145:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578911616 00000100:00100000:0.0:1789265394.676153:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578911616 00000100:00100000:0.0:1789265394.676200:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789265394.676208:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578911616:12345-0@lo:400: 00000100:00100000:0.0:1789265394.676262:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578911616:12345-0@lo:400: Request processed in 54us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265394.676269:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789265394.676302:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578912128 00000100:00100000:0.0:1789265394.676305:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578912128 00000100:00100000:0.0:1789265394.676332:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789265394.676338:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578912128:12345-0@lo:400: 00000100:00100000:0.0:1789265394.676371:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578912128:12345-0@lo:400: Request processed in 34us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265394.676378:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789265394.676429:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578912000 00000100:00100000:0.0:1789265394.676433:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578912000 00000100:00100000:0.0:1789265394.676454:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578911744 00000100:00100000:0.0:1789265394.676456:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578911744 00000100:00100000:0.0:1789265394.676468:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578912256 00000100:00100000:0.0:1789265394.676470:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578912256 00000100:00100000:0.0:1789265394.676493:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578912768 00000100:00100000:0.0:1789265394.676496:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578912768 00000100:00100000:0.0:1789265394.676512:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789265394.676518:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578912000:12345-0@lo:400: 00000100:00100000:0.0:1789265394.676552:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578912000:12345-0@lo:400: Request processed in 35us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265394.676570:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789265394.676583:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789265394.676589:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578911744:12345-0@lo:400: 00000100:00100000:0.0:1789265394.676635:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578911744:12345-0@lo:400: Request processed in 45us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265394.676641:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789265394.676654:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789265394.676661:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578912256:12345-0@lo:400: 00000100:00100000:1.0:1789265394.677225:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789265394.677237:0:6519:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789265394.677254:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789265394.677264:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265394.677274:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578912768:12345-0@lo:400: 00000100:00100000:2.0:1789265394.677353:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578911872:0@lo:400: 00000100:00100000:3.0:1789265394.677429:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265394.677493:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578912256:12345-0@lo:400: Request processed in 832us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265394.677501:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1789265394.677525:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265394.678062:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578912768:12345-0@lo:400: Request processed in 789us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265394.678075:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265394.678182:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578912512 00000100:00100000:1.0:1789265394.678188:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578912512 00000100:00100000:1.0:1789265394.678233:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265394.678240:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578912512:12345-0@lo:400: 00000100:00100000:1.0:1789265394.678273:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578912512:12345-0@lo:400: Request processed in 35us (2935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265394.678278:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789265394.680173:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265394.680938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265394.680985:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578912384:0@lo:400: 00000100:00100000:2.0:1789265394.681018:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265394.681037:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180578912896:0@lo:400: 00000100:00100000:2.0:1789265394.681060:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265394.681103:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578912384 00000100:00100000:2.0:1789265394.681110:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578912384 00000100:00100000:2.0:1789265394.681156:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578912896 00000100:00100000:2.0:1789265394.681159:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578912896 00000100:00100000:2.0:1789265394.681178:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789265394.681186:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578912384:12345-0@lo:400: 00000100:00100000:2.0:1789265394.681235:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578912384:12345-0@lo:400: Request processed in 50us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265394.681242:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789265394.681259:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789265394.681265:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180578912896:12345-0@lo:400: 00000100:00100000:2.0:1789265394.681290:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180578912896:12345-0@lo:400: Request processed in 26us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265394.681296:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789265394.681313:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789265394.681342:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f159f80 x1876180578912384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265394.681356:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578912384:0@lo:400: 00010000:00080000:2.0:1789265394.681380:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f158380 x1876180578912896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265394.681406:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180578912896:0@lo:400: 00000100:00100000:1.0:1789265394.682473:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578911872 00000100:00100000:1.0:1789265394.682498:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578911872 00000100:00100000:1.0:1789265394.682573:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265394.682582:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578911872:12345-0@lo:400: 00000100:00100000:1.0:1789265394.682979:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578911872:12345-0@lo:400: Request processed in 104us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265394.682987:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789265394.689987:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578911872:0@lo:400: 00010000:00080000:3.0:1789265394.691120:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f15b480 x1876180578912512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265394.691133:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578912512:0@lo:400: 00000100:00100000:3.0:1789265394.691147:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578913024:0@lo:400: 00000100:00100000:3.0:1789265394.691204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789265394.691255:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775285c700 x1876180578912000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265394.691265:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578912000:0@lo:400: 00000100:00100000:1.0:1789265394.691334:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578913024 00000100:00100000:1.0:1789265394.691341:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578913024 00000100:00100000:1.0:1789265394.691414:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265394.691424:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578913024:12345-0@lo:400: 00000100:00100000:1.0:1789265394.691485:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578913024:12345-0@lo:400: Request processed in 63us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265394.691493:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789265394.691889:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789265394.691994:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f15b100 x1876180578913024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265394.692004:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789265394.692018:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578913024:0@lo:400: 00000100:00100000:0.0:1789265394.695032:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265394.695189:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578913152:0@lo:400: 00000100:00100000:0.0:1789265394.695257:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789265394.706335:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376434d4a80 x1876180578911744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265394.706365:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578911744:0@lo:400: 00010000:00080000:0.0:1789265394.706382:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f15bb80 x1876180578912256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265394.706409:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578912256:0@lo:400: 00010000:00080000:0.0:1789265394.706423:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f15a300 x1876180578912768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265394.706431:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578912768:0@lo:400: 00000100:00100000:0.0:1789265394.706503:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578911616:0@lo:400: 00000100:00100000:0.0:1789265394.706516:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578912128:0@lo:400: 00000100:00100000:1.0:1789265394.710369:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578912640 00000100:00100000:1.0:1789265394.710400:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578912640 00000100:00100000:1.0:1789265394.710496:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578913152 00000100:00100000:1.0:1789265394.710500:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578913152 00000100:00100000:1.0:1789265394.710529:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265394.710541:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578912640:12345-0@lo:400: 00000100:00100000:0.0:1789265394.710935:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265394.710947:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578913152:12345-0@lo:400: 00000100:00100000:0.0:1789265394.711022:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578913152:12345-0@lo:400: Request processed in 79us (15763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265394.711029:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789265394.711080:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f158700 x1876180578913152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265394.711103:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789265394.711127:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578913152:0@lo:400: 00000100:00100000:1.0:1789265394.711308:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578912640:12345-0@lo:400: Request processed in 768us (16283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265394.711315:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789265394.711409:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265394.711414:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265394.711525:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f158000 x1876180578912640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265394.711536:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578912640:0@lo:400: 00000100:00100000:2.0:1789265395.187295:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265395.187329:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578913280:0@lo:13: 00000100:00100000:2.0:1789265395.187421:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265395.188008:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578913280 00000100:00100000:1.0:1789265395.188019:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578913280 00000100:00100000:1.0:1789265395.188080:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265395.188090:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578913280:12345-0@lo:13: 00002000:00000024:1.0:1789265395.188123:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265395.188184:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578913280:12345-0@lo:13: Request processed in 95us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265395.188201:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789265395.188506:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642752a00 x1876180578913280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265395.188527:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578913280:0@lo:13: 00000100:00100000:0.0:1789265395.191024:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265395.191047:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764241b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578913408:0@lo:13: 00000100:00100000:0.0:1789265395.191133:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265395.191258:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578913408 00000100:00100000:0.0:1789265395.191265:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578913408 00000100:00100000:0.0:1789265395.191308:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265395.191316:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578913408:12345-0@lo:13: 00002000:00000024:0.0:1789265395.191337:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265395.191428:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578913408:12345-0@lo:13: Request processed in 112us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265395.191444:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789265395.191492:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764241b800 x1876180578913408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265395.191510:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764241b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578913408:0@lo:13: 00010000:00010000:3.0:1789265395.254051:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265396.208931:0:10038:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265396.209215:0:10038:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789265396.215185:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265396.215226:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578913536:0@lo:41: 00000100:00100000:3.0:1789265396.215309:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265396.215961:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578913536 00000100:00100000:3.0:1789265396.215972:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578913536 00000100:00100000:3.0:1789265396.216025:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789265396.216037:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578913536:12345-0@lo:41: 00000004:00000024:3.0:1789265396.216071:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265396.216127:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578913536:12345-0@lo:41: Request processed in 93us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265396.216135:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789265396.216185:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578913536:0@lo:41: 00000100:00100000:2.0:1789265396.219663:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578913664:0@lo:41: 00000100:00100000:2.0:1789265396.219741:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265396.220721:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578913664 00000100:00100000:3.0:1789265396.220732:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578913664 00000100:00100000:3.0:1789265396.220789:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265396.220798:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578913664:12345-0@lo:41: 00000004:00000024:3.0:1789265396.220834:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789265396.220928:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578913664:12345-0@lo:41: Request processed in 131us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265396.220935:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789265396.220970:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578913664:0@lo:41: 00010000:00010000:1.0:1789265396.278986:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265396.723065:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578913792:0@lo:13: 00000100:00100000:0.0:1789265396.723160:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265396.723364:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578913792 00000100:00100000:3.0:1789265396.723387:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578913792 00000100:00100000:3.0:1789265396.723457:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265396.723480:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578913792:12345-0@lo:13: 00002000:00000024:3.0:1789265396.723513:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265396.723567:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578913792:12345-0@lo:13: Request processed in 91us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265396.723588:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789265396.723635:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764354ca80 x1876180578913792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265396.723663:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578913792:0@lo:13: 00000100:00080000:0.0:1789265396.723881:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265396.724706:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578913920:0@lo:13: 00000100:00100000:3.0:1789265396.724753:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265396.724808:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578913920 00000100:00100000:3.0:1789265396.724814:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578913920 00000100:00100000:3.0:1789265396.724855:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265396.724886:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578913920:12345-0@lo:13: 00002000:00000024:3.0:1789265396.724902:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265396.724936:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578913920:12345-0@lo:13: Request processed in 51us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265396.724943:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789265396.724962:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265396.724984:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764354ca80 x1876180578913920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265396.724999:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578913920:0@lo:13: 00010000:00010000:0.0:1789265397.307931:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265397.324108:0:10086:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265397.324119:0:10086:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1789265398.323769:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265399.249798:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265399.249941:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556841344 00000100:00100000:0.0:1789265399.249953:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556841344 00000100:00100000:0.0:1789265399.250008:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 184 00000100:00100000:0.0:1789265399.250017:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2396:x1876180556841344:12345-192.168.202.42@tcp:250: 00010000:00080000:0.0:1789265399.250048:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 63f6cd89-abac-4801-8de9-f59ae281263f@192.168.202.42@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:0.0:1789265399.250081:0:6512:0:(genops.c:1385:class_connect()) connect: client 63f6cd89-abac-4801-8de9-f59ae281263f, cookie 0xbbfdc9019c1d39c1 00000100:00080000:0.0:1789265399.250241:0:6512:0:(import.c:65:import_set_state_nolock()) ffff93777aaf2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265399.250322:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+5:2396:x1876180556841344:12345-192.168.202.42@tcp:250: Request processed in 303us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265399.250330:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 184 00000100:00100000:3.0:1789265399.262074:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265399.262586:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556841216 00000100:00100000:0.0:1789265399.262602:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556841216 00000100:00100000:0.0:1789265399.262695:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 185 00000100:00100000:0.0:1789265399.262707:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+5:6159:x1876180556841216:12345-192.168.202.42@tcp:101: 00010000:00010000:0.0:1789265399.262732:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265399.262759:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937782162a00/0xbbfdc9019c1d39c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d918fdf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265399.262818:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937782162a00/0xbbfdc9019c1d39c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fdf expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265399.262831:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937782162a00/0xbbfdc9019c1d39c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fdf expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265399.262843:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937782162a00, rc 0) 00000100:00100000:0.0:1789265399.262978:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+6:6159:x1876180556841216:12345-192.168.202.42@tcp:101: Request processed in 271us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265399.262986:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 185 00000100:00100000:3.0:1789265399.270656:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265399.270857:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556841472 00000100:00100000:2.0:1789265399.270922:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556841472 00000100:00100000:2.0:1789265399.271000:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 186 00000100:00100000:2.0:1789265399.271014:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+6:6159:x1876180556841472:12345-192.168.202.42@tcp:501: 00000100:00100000:2.0:1789265399.271195:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+6:6159:x1876180556841472:12345-192.168.202.42@tcp:501: Request processed in 183us (556us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265399.271204:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 186 00000100:00100000:1.0:1789265399.274376:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265399.274543:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556841600 00000100:00100000:2.0:1789265399.274555:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556841600 00000100:00100000:2.0:1789265399.274640:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 187 00000100:00100000:2.0:1789265399.274652:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775011b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+6:6159:x1876180556841600:12345-192.168.202.42@tcp:101: 00010000:00010000:2.0:1789265399.274676:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265399.274700:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9376435fc800/0xbbfdc9019c1d39cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d918fe6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265399.274737:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fc800/0xbbfdc9019c1d39cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fe6 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265399.274751:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9376435fc800/0xbbfdc9019c1d39cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fe6 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265399.274762:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc800, rc 0) 00000100:00100000:2.0:1789265399.274836:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775011b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+7:6159:x1876180556841600:12345-192.168.202.42@tcp:101: Request processed in 185us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265399.274844:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 187 00000100:00100000:3.0:1789265399.277776:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265399.277923:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556841728 00000100:00100000:0.0:1789265399.277935:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556841728 00000100:00100000:0.0:1789265399.278010:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 188 00000100:00100000:0.0:1789265399.278023:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+7:6159:x1876180556841728:12345-192.168.202.42@tcp:501: 00000100:00100000:0.0:1789265399.278261:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+8:6159:x1876180556841728:12345-192.168.202.42@tcp:501: Request processed in 241us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265399.278269:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 188 00000100:00100000:3.0:1789265399.294639:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265399.294801:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556841856 00000100:00100000:0.0:1789265399.294817:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556841856 00000100:00100000:0.0:1789265399.294933:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 189 00000100:00100000:0.0:1789265399.294945:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+8:6159:x1876180556841856:12345-192.168.202.42@tcp:503: 00000100:00100000:0.0:1789265399.295157:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+8:6159:x1876180556841856:12345-192.168.202.42@tcp:503: Request processed in 214us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265399.295173:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 189 00000100:00100000:1.0:1789265399.298897:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265399.299010:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556841984 00000100:00100000:2.0:1789265399.299025:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556841984 00000100:00100000:2.0:1789265399.299119:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 190 00000100:00100000:2.0:1789265399.299132:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+8:6178:x1876180556841984:12345-192.168.202.42@tcp:502: 00000100:00100000:2.0:1789265399.299364:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+8:6178:x1876180556841984:12345-192.168.202.42@tcp:502: Request processed in 235us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265399.299373:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 190 00010000:00010000:0.0:1789265399.352754:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265399.392414:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265399.392557:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556842112 00000100:00100000:2.0:1789265399.392573:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556842112 00000100:00100000:2.0:1789265399.392651:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 191 00000100:00100000:2.0:1789265399.392664:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775011b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+8:6178:x1876180556842112:12345-192.168.202.42@tcp:502: 00000100:00100000:2.0:1789265399.392920:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775011b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+8:6178:x1876180556842112:12345-192.168.202.42@tcp:502: Request processed in 258us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265399.392930:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 191 00000100:00100000:3.0:1789265399.399149:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265399.399285:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556842240 00000100:00100000:0.0:1789265399.399299:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556842240 00000100:00100000:0.0:1789265399.399384:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 192 00000100:00100000:0.0:1789265399.399395:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+8:6159:x1876180556842240:12345-192.168.202.42@tcp:101: 00010000:00010000:0.0:1789265399.399416:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265399.399439:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937782163600/0xbbfdc9019c1d39d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919017 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265399.399475:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937782163600/0xbbfdc9019c1d39d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919017 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265399.399488:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937782163600/0xbbfdc9019c1d39d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919017 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265399.399499:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937782163600, rc 0) 00000100:00100000:0.0:1789265399.399578:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+9:6159:x1876180556842240:12345-192.168.202.42@tcp:101: Request processed in 184us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265399.399586:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 192 00000100:00100000:1.0:1789265399.410081:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265399.410503:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556842368 00000100:00100000:0.0:1789265399.410523:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556842368 00000100:00100000:0.0:1789265399.410621:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 193 00000100:00100000:0.0:1789265399.410636:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+9:6159:x1876180556842368:12345-192.168.202.42@tcp:256: 20000000:01000000:0.0:1789265399.410672:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789265399.410709:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789265399.410714:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789265399.410717:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789265399.410720:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789265399.410723:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789265399.415156:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+9:6159:x1876180556842368:12345-192.168.202.42@tcp:256: Request processed in 4507us (5075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265399.415187:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 193 00000100:00100000:3.0:1789265399.423316:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265399.423467:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556842496 00000100:00100000:2.0:1789265399.423481:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556842496 00000100:00100000:2.0:1789265399.423564:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 194 00000100:00100000:2.0:1789265399.423578:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+9:6159:x1876180556842496:12345-192.168.202.42@tcp:101: 00010000:00010000:2.0:1789265399.423604:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265399.423629:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9376435fde00/0xbbfdc9019c1d39dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91901e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265399.423669:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fde00/0xbbfdc9019c1d39dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91901e expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265399.423685:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9376435fde00/0xbbfdc9019c1d39dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91901e expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265399.423697:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fde00, rc 0) 00000100:00100000:2.0:1789265399.423772:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+10:6159:x1876180556842496:12345-192.168.202.42@tcp:101: Request processed in 197us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265399.423780:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 194 00000100:00100000:1.0:1789265399.428202:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265399.428571:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556842624 00000100:00100000:0.0:1789265399.428588:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556842624 00000100:00100000:0.0:1789265399.428690:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 195 00000100:00100000:0.0:1789265399.428704:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+10:6159:x1876180556842624:12345-192.168.202.42@tcp:501: 00000100:00100000:0.0:1789265399.428978:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+10:6159:x1876180556842624:12345-192.168.202.42@tcp:501: Request processed in 277us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265399.428988:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 195 00000100:00100000:3.0:1789265399.438717:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265399.439393:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556842752 00000100:00100000:0.0:1789265399.439412:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556842752 00000100:00100000:0.0:1789265399.439499:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 196 00000100:00100000:0.0:1789265399.439510:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:6159:x1876180556842752:12345-192.168.202.42@tcp:503: 00000100:00100000:0.0:1789265399.439737:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:6159:x1876180556842752:12345-192.168.202.42@tcp:503: Request processed in 227us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265399.439745:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 196 00000100:00100000:3.0:1789265399.445139:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265399.447747:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556842880 00000100:00100000:2.0:1789265399.447768:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556842880 00000100:00100000:2.0:1789265399.447900:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 197 00000100:00100000:2.0:1789265399.447914:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+10:6186:x1876180556842880:12345-192.168.202.42@tcp:502: 00000100:00100000:2.0:1789265399.448156:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+10:6186:x1876180556842880:12345-192.168.202.42@tcp:502: Request processed in 243us (3031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265399.448176:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 197 00000100:00100000:1.0:1789265399.457107:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265399.458924:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556843008 00000100:00100000:2.0:1789265399.458944:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556843008 00000100:00100000:2.0:1789265399.459043:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 198 00000100:00100000:2.0:1789265399.459056:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+10:6186:x1876180556843008:12345-192.168.202.42@tcp:502: 00000100:00100000:2.0:1789265399.459281:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+10:6186:x1876180556843008:12345-192.168.202.42@tcp:502: Request processed in 227us (2189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265399.459289:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 198 00000100:00100000:3.0:1789265399.474297:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265399.475375:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265399.476229:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556843136 00000100:00100000:1.0:1789265399.476246:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556843136 00000100:00100000:1.0:1789265399.476306:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556843392 00000100:00100000:1.0:1789265399.476310:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556843392 00000100:00100000:1.0:1789265399.476341:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:1.0:1789265399.476361:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876180556843136:12345-192.168.202.42@tcp:38: 00010000:00080000:1.0:1789265399.476406:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1789265399.476480:0:6519:0:(genops.c:1385:class_connect()) connect: client f16c02c5-6a63-4180-875a-2aaaca684c23, cookie 0xbbfdc9019c1d39e4 00000004:00100000:1.0:1789265399.476514:0:6519:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1789265399.476812:0:6519:0:(import.c:65:import_set_state_nolock()) ffff93764276f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265399.476940:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2396:x1876180556843136:12345-192.168.202.42@tcp:38: Request processed in 579us (2658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265399.476950:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:1.0:1789265399.476975:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:1.0:1789265399.476981:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876180556843392:12345-192.168.202.42@tcp:38: 00010000:00080000:1.0:1789265399.476999:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1789265399.477038:0:6519:0:(genops.c:1385:class_connect()) connect: client f16c02c5-6a63-4180-875a-2aaaca684c23, cookie 0xbbfdc9019c1d39eb 00000004:00100000:1.0:1789265399.477068:0:6519:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1789265399.477245:0:6519:0:(import.c:65:import_set_state_nolock()) ffff93777f36b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265399.477272:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2396:x1876180556843392:12345-192.168.202.42@tcp:38: Request processed in 289us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265399.477279:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:3.0:1789265399.795616:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578914432:0@lo:400: 00000100:00100000:3.0:1789265399.795717:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265399.795804:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578914944:0@lo:400: 00000100:00100000:3.0:1789265399.795834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265399.795884:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578915456:0@lo:400: 00000100:00100000:3.0:1789265399.795908:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265399.795938:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789265399.795943:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578914048:0@lo:400: 00000100:00100000:3.0:1789265399.795971:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265399.795987:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578914560:0@lo:400: 00000100:00100000:3.0:1789265399.796007:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265399.796020:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578915072:0@lo:400: 00000100:00100000:3.0:1789265399.796035:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265399.796051:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578915584:0@lo:400: 00000100:00100000:3.0:1789265399.796068:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265399.796093:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578914304:0@lo:400: 00000100:00100000:3.0:1789265399.796114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265399.796128:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578914816:0@lo:400: 00000100:00100000:3.0:1789265399.796145:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265399.796157:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180578915328:0@lo:400: 00000100:00100000:3.0:1789265399.796173:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265399.796188:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789265399.796192:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642750e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578914176:0@lo:400: 00000100:00100000:3.0:1789265399.796209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265399.796233:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578914688:0@lo:400: 00000100:00100000:3.0:1789265399.796251:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265399.796258:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578915200:0@lo:400: 00000100:00100000:3.0:1789265399.796284:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265399.796312:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578914944 00000100:00100000:3.0:1789265399.796329:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578914944 00000100:00100000:3.0:1789265399.796398:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578915456 00000100:00100000:3.0:1789265399.796401:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578915456 00000100:00100000:3.0:1789265399.796416:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578915072 00000100:00100000:3.0:1789265399.796418:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578915072 00000100:00100000:3.0:1789265399.796428:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578915584 00000100:00100000:3.0:1789265399.796430:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578915584 00000100:00100000:3.0:1789265399.796445:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265399.796455:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578914944:12345-0@lo:400: 00000100:00100000:3.0:1789265399.796510:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578914944:12345-0@lo:400: Request processed in 56us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265399.796518:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265399.796537:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265399.796541:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578915456:12345-0@lo:400: 00000100:00100000:3.0:1789265399.796563:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578915456:12345-0@lo:400: Request processed in 22us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265399.796568:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265399.796577:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265399.796582:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578915072:12345-0@lo:400: 00000100:00100000:3.0:1789265399.796601:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578915072:12345-0@lo:400: Request processed in 19us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265399.796607:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265399.796615:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265399.796627:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578915584:12345-0@lo:400: 00000100:00100000:3.0:1789265399.796653:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578915584:12345-0@lo:400: Request processed in 26us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265399.796659:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265399.796679:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578914560 00000100:00100000:3.0:1789265399.796681:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578914560 00000100:00100000:3.0:1789265399.796698:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578914304 00000100:00100000:3.0:1789265399.796700:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578914304 00000100:00100000:3.0:1789265399.796711:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789265399.796716:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578914560:12345-0@lo:400: 00000100:00100000:3.0:1789265399.796750:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578914560:12345-0@lo:400: Request processed in 34us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265399.796757:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789265399.796767:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789265399.796772:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578914304:12345-0@lo:400: 00000100:00100000:3.0:1789265399.796800:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578914304:12345-0@lo:400: Request processed in 28us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265399.796805:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789265399.796821:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578914432 00000100:00100000:3.0:1789265399.796824:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578914432 00000100:00100000:3.0:1789265399.796841:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578914816 00000100:00100000:3.0:1789265399.796844:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578914816 00000100:00100000:3.0:1789265399.796855:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578915328 00000100:00100000:3.0:1789265399.796889:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578915328 00000100:00100000:3.0:1789265399.796901:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578914176 00000100:00100000:3.0:1789265399.796903:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578914176 00000100:00100000:3.0:1789265399.796911:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578914688 00000100:00100000:3.0:1789265399.796914:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578914688 00000100:00100000:3.0:1789265399.796925:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578915200 00000100:00100000:3.0:1789265399.796933:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578915200 00000100:00100000:3.0:1789265399.796947:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265399.796952:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578914432:12345-0@lo:400: 00000100:00100000:3.0:1789265399.796982:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578914432:12345-0@lo:400: Request processed in 29us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265399.796987:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265399.796996:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789265399.797001:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578914816:12345-0@lo:400: 00000100:00100000:3.0:1789265399.797021:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578914816:12345-0@lo:400: Request processed in 21us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265399.797026:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789265399.797034:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789265399.797039:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180578915328:12345-0@lo:400: 00000100:00100000:3.0:1789265399.797058:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180578915328:12345-0@lo:400: Request processed in 19us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265399.797063:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789265399.797071:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789265399.797076:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578914176:12345-0@lo:400: 00000100:00100000:3.0:1789265399.797094:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578914176:12345-0@lo:400: Request processed in 18us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265399.797099:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789265399.797107:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265399.797112:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578914688:12345-0@lo:400: 00000100:00100000:3.0:1789265399.797131:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578914688:12345-0@lo:400: Request processed in 19us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265399.797137:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265399.797151:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265399.797156:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578915200:12345-0@lo:400: 00000100:00100000:3.0:1789265399.797177:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578915200:12345-0@lo:400: Request processed in 22us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265399.797183:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1789265399.797199:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265399.797203:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265399.797206:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265399.797208:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265399.797240:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642750e00 x1876180578914176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265399.797256:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642750e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578914176:0@lo:400: 00010000:00080000:3.0:1789265399.797266:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2fd500 x1876180578914688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265399.797274:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578914688:0@lo:400: 00010000:00080000:3.0:1789265399.797283:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2fea00 x1876180578915200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265399.797292:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578915200:0@lo:400: 00000100:00100000:3.0:1789265399.797300:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578914304:0@lo:400: 00010000:00080000:3.0:1789265399.797309:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2fd180 x1876180578914816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265399.797317:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578914816:0@lo:400: 00010000:00080000:3.0:1789265399.797325:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2fc380 x1876180578915328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265399.797357:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180578915328:0@lo:400: 00000100:00100000:3.0:1789265399.797407:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578914560:0@lo:400: 00010000:00080000:3.0:1789265399.797417:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2fdf80 x1876180578915072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265399.797425:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578915072:0@lo:400: 00010000:00080000:3.0:1789265399.797434:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2fc700 x1876180578915584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265399.797441:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578915584:0@lo:400: 00010000:00080000:3.0:1789265399.797449:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642753480 x1876180578914432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265399.797456:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578914432:0@lo:400: 00010000:00080000:3.0:1789265399.797465:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2fed80 x1876180578914944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265399.797473:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578914944:0@lo:400: 00010000:00080000:3.0:1789265399.797483:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2ff480 x1876180578915456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265399.797491:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578915456:0@lo:400: 00000100:00100000:0.0:1789265399.797829:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578914048 00000100:00100000:0.0:1789265399.797836:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578914048 00000100:00100000:0.0:1789265399.797914:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789265399.797922:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578914048:12345-0@lo:400: 00000100:00100000:0.0:1789265399.797980:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578914048:12345-0@lo:400: Request processed in 60us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265399.797987:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789265399.798026:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578914048:0@lo:400: 00000100:00100000:2.0:1789265400.257227:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265400.257384:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265400.257546:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556843520 00000100:00100000:0.0:1789265400.257570:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556843520 00000100:00100000:3.0:1789265400.257829:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556843648 00000100:00100000:3.0:1789265400.257835:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556843648 00000100:00100000:0.0:1789265400.258451:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:0.0:1789265400.258469:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:0:x1876180556843520:12345-192.168.202.42@tcp:41: 00000004:00000024:0.0:1789265400.258530:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265400.258645:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:0:x1876180556843520:12345-192.168.202.42@tcp:41: Request processed in 170us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265400.258654:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00080000:1.0:1789265400.259185:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265400.259193:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265400.265683:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:1.0:1789265400.265684:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265400.265708:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6159:x1876180556843648:12345-192.168.202.42@tcp:41: 00000004:00000024:3.0:1789265400.265789:0:9988:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789265400.265969:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6159:x1876180556843648:12345-192.168.202.42@tcp:41: Request processed in 268us (8584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265400.265979:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:3.0:1789265400.266000:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556843264 00000100:00100000:3.0:1789265400.266011:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556843264 00000100:00100000:3.0:1789265400.266047:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:3.0:1789265400.266055:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:0:x1876180556843264:12345-192.168.202.42@tcp:41: 00000004:00000024:3.0:1789265400.266068:0:9988:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789265400.266093:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:0:x1876180556843264:12345-192.168.202.42@tcp:41: Request processed in 38us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265400.266101:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:2.0:1789265400.267989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265400.268098:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556843776 00000100:00100000:0.0:1789265400.268113:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556843776 00000100:00100000:0.0:1789265400.268222:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:0.0:1789265400.268235:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6159:x1876180556843776:12345-192.168.202.42@tcp:40: 00000100:00100000:0.0:1789265400.268358:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6159:x1876180556843776:12345-192.168.202.42@tcp:40: Request processed in 126us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265400.268366:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:1.0:1789265400.272253:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265400.272377:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265400.272417:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265400.272458:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265400.272500:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556843904 00000100:00100000:1.0:1789265400.272513:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556843904 00000100:00100000:1.0:1789265400.272576:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556844032 00000100:00100000:1.0:1789265400.272579:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556844032 00000100:00100000:1.0:1789265400.272643:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:1.0:1789265400.272653:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1876180556843904:12345-192.168.202.42@tcp:8: 00010000:00080000:1.0:1789265400.272697:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1789265400.272737:0:8436:0:(genops.c:1385:class_connect()) connect: client f16c02c5-6a63-4180-875a-2aaaca684c23, cookie 0xbbfdc9019c1d39f2 00002000:00100000:1.0:1789265400.272754:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f16c02c5-6a63-4180-875a-2aaaca684c23/ffff93777f36f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789265400.272779:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789265400.273063:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789265400.273103:0:8436:0:(import.c:65:import_set_state_nolock()) ffff93777f369800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265400.273183:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2396:x1876180556843904:12345-192.168.202.42@tcp:8: Request processed in 529us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265400.273192:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:1.0:1789265400.273221:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:1.0:1789265400.273226:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1876180556844032:12345-192.168.202.42@tcp:8: 00010000:00080000:1.0:1789265400.273244:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1789265400.273264:0:8436:0:(genops.c:1385:class_connect()) connect: client f16c02c5-6a63-4180-875a-2aaaca684c23, cookie 0xbbfdc9019c1d39f9 00002000:00100000:1.0:1789265400.273270:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f16c02c5-6a63-4180-875a-2aaaca684c23/ffff93777f369000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789265400.273283:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789265400.273412:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789265400.273428:0:8436:0:(import.c:65:import_set_state_nolock()) ffff93777f36e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265400.273455:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2396:x1876180556844032:12345-192.168.202.42@tcp:8: Request processed in 227us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265400.273462:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:0.0:1789265400.274481:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556844288 00000100:00100000:0.0:1789265400.274494:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556844288 00000100:00100000:0.0:1789265400.274557:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 200 00000100:00100000:0.0:1789265400.274568:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+10:2398:x1876180556844288:12345-192.168.202.42@tcp:400: 00000100:00100000:0.0:1789265400.274643:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+10:2398:x1876180556844288:12345-192.168.202.42@tcp:400: Request processed in 77us (2266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265400.274650:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 200 00000100:00100000:3.0:1789265400.275130:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556844160 00000100:00100000:3.0:1789265400.275137:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556844160 00000100:00100000:3.0:1789265400.275188:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:3.0:1789265400.275196:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6159:x1876180556844160:12345-192.168.202.42@tcp:900: 00000100:00100000:3.0:1789265400.275256:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6159:x1876180556844160:12345-192.168.202.42@tcp:900: Request processed in 61us (3019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265400.275263:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:2.0:1789265400.282068:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265400.282204:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556844416 00000100:00100000:3.0:1789265400.282218:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556844416 00000100:00100000:3.0:1789265400.282286:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:3.0:1789265400.282297:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6159:x1876180556844416:12345-192.168.202.42@tcp:33: 00000100:00100000:0.0:1789265400.307495:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578915712:0@lo:13: 00000100:00100000:0.0:1789265400.307616:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265400.307740:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578915712 00000100:00100000:0.0:1789265400.307752:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578915712 00000100:00100000:0.0:1789265400.307829:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265400.307841:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578915712:12345-0@lo:13: 00000004:00080000:3.0:1789265400.307903:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25462us 00002000:00000024:0.0:1789265400.307906:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265400.307971:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578915712:12345-0@lo:13: Request processed in 132us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265400.307979:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789265400.308038:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642418000 x1876180578915712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265400.308062:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578915712:0@lo:13: 00000100:00100000:1.0:1789265400.308716:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265400.308731:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578915840:0@lo:13: 00000100:00100000:1.0:1789265400.308777:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265400.309407:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578915840 00000100:00100000:0.0:1789265400.309416:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578915840 00000100:00100000:0.0:1789265400.309472:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265400.309482:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578915840:12345-0@lo:13: 00002000:00000024:0.0:1789265400.309501:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265400.309556:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578915840:12345-0@lo:13: Request processed in 76us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265400.309564:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789265400.309611:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2ff100 x1876180578915840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265400.309630:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578915840:0@lo:13: 00000004:00200000:3.0:1789265400.353788:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789265400.353956:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6159:x1876180556844416:12345-192.168.202.42@tcp:33: Request processed in 71652us (71894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265400.353967:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00010000:00010000:1.0:1789265400.371637:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265400.587172:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265400.587292:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556844544 00000100:00100000:3.0:1789265400.587309:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556844544 00000100:00100000:3.0:1789265400.587400:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:3.0:1789265400.587415:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6204:x1876180556844544:12345-192.168.202.42@tcp:101: 00010000:00010000:3.0:1789265400.587450:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265400.587693:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643219600/0xbbfdc9019c1d3a00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91904f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.587791:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3a07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.587806:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3a07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.587823:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3a07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265400.589031:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265400.589040:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265400.589067:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3a07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.589110:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219600/0xbbfdc9019c1d3a00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91904f expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.589136:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3a07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91904f expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265400.589168:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774e578f00) 00010000:00010000:3.0:1789265400.589171:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265400.589175:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643218a00, rc 0) 00000100:00100000:3.0:1789265400.589357:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+7:6204:x1876180556844544:12345-192.168.202.42@tcp:101: Request processed in 1943us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265400.589367:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:1.0:1789265401.331121:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265401.331151:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578915968:0@lo:41: 00000100:00100000:1.0:1789265401.331227:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265401.331352:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578915968 00000100:00100000:3.0:1789265401.331360:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578915968 00000100:00100000:3.0:1789265401.331416:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789265401.331426:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578915968:12345-0@lo:41: 00000004:00000024:3.0:1789265401.331462:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265401.331506:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578915968:12345-0@lo:41: Request processed in 82us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265401.331513:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789265401.331573:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578916096:0@lo:41: 00000100:00100000:1.0:1789265401.331600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265401.331652:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578915968:0@lo:41: 00000100:00100000:3.0:1789265401.331716:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578916096 00000100:00100000:3.0:1789265401.331721:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578916096 00000100:00100000:3.0:1789265401.331754:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789265401.331761:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578916096:12345-0@lo:41: 00000004:00000024:3.0:1789265401.331803:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789265401.331880:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578916096:12345-0@lo:41: Request processed in 98us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265401.331887:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265401.331959:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578916096:0@lo:41: 00010000:00010000:0.0:1789265401.397787:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265401.844976:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578916352:0@lo:13: 00000100:00100000:2.0:1789265401.845064:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265401.845155:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265401.845163:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578916224:0@lo:13: 00000100:00100000:2.0:1789265401.845187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265401.845261:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578916352 00000100:00100000:1.0:1789265401.845269:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578916352 00000100:00100000:1.0:1789265401.845349:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578916224 00000100:00100000:1.0:1789265401.845364:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578916224 00000100:00100000:1.0:1789265401.845386:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789265401.845394:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578916352:12345-0@lo:13: 00002000:00000024:1.0:1789265401.845425:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265401.845471:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578916352:12345-0@lo:13: Request processed in 78us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265401.845477:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789265401.845495:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789265401.845501:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578916224:12345-0@lo:13: 00002000:00000024:1.0:1789265401.845510:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265401.845532:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578916224:12345-0@lo:13: Request processed in 31us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265401.845537:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789265401.845571:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36c700 x1876180578916224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265401.845591:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578916224:0@lo:13: 00010000:00080000:1.0:1789265401.845603:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2fdc00 x1876180578916352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265401.845613:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578916352:0@lo:13: 00000100:00080000:2.0:1789265401.845688:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789265402.419035:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265402.787266:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265402.787354:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556844672 00000100:00100000:3.0:1789265402.787364:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556844672 00000100:00100000:3.0:1789265402.787444:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:3.0:1789265402.787455:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+7:6256:x1876180556844672:12345-192.168.202.42@tcp:41: 00000004:00000024:3.0:1789265402.787512:0:9988:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789265402.787598:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+7:6256:x1876180556844672:12345-192.168.202.42@tcp:41: Request processed in 144us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265402.787607:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00080000:2.0:1789265402.787679:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265402.798336:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265402.800156:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556844800 00000100:00100000:0.0:1789265402.800173:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556844800 00000100:00100000:0.0:1789265402.800352:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:0.0:1789265402.800366:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6256:x1876180556844800:12345-192.168.202.42@tcp:41: 00000004:00000024:0.0:1789265402.800410:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265402.800510:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6256:x1876180556844800:12345-192.168.202.42@tcp:41: Request processed in 146us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265402.800541:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00080000:2.0:1789265402.802736:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265402.810921:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265402.811041:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556844928 00000100:00100000:0.0:1789265402.811054:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556844928 00000100:00100000:0.0:1789265402.811142:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:0.0:1789265402.811156:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6256:x1876180556844928:12345-192.168.202.42@tcp:13: 00002000:00000024:0.0:1789265402.811188:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265402.811268:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6256:x1876180556844928:12345-192.168.202.42@tcp:13: Request processed in 116us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265402.811276:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00080000:2.0:1789265402.811969:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265402.821024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265402.821189:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556845056 00000100:00100000:0.0:1789265402.821198:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556845056 00000100:00100000:0.0:1789265402.821260:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:0.0:1789265402.821269:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6256:x1876180556845056:12345-192.168.202.42@tcp:13: 00002000:00000024:0.0:1789265402.821305:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265402.821381:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f16c02c5-6a63-4180-875a-2aaaca684c23+6:6256:x1876180556845056:12345-192.168.202.42@tcp:13: Request processed in 112us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265402.821388:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00080000:2.0:1789265402.821454:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1789265403.381660:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f16c02c5-6a63-4180-875a-2aaaca684c23 00010000:00010000:0.0:1789265403.443215:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265404.470434:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265404.915728:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180578916608:0@lo:400: 00000100:00100000:1.0:1789265404.915823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.915921:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180578917120:0@lo:400: 00000100:00100000:1.0:1789265404.915947:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.915973:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376426dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876180578917632:0@lo:400: 00000100:00100000:1.0:1789265404.916002:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.916038:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789265404.916045:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578916480:0@lo:400: 00000100:00100000:1.0:1789265404.916078:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.916101:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578916992:0@lo:400: 00000100:00100000:1.0:1789265404.916127:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.916146:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376426de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578917504:0@lo:400: 00000100:00100000:1.0:1789265404.916171:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.916190:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376426dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578918016:0@lo:400: 00000100:00100000:1.0:1789265404.916211:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.916243:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578916736:0@lo:400: 00000100:00100000:1.0:1789265404.916271:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.916290:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578917248:0@lo:400: 00000100:00100000:1.0:1789265404.916324:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.916341:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376426ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578917760:0@lo:400: 00000100:00100000:1.0:1789265404.916378:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.916393:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789265404.916399:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578916864:0@lo:400: 00000100:00100000:1.0:1789265404.916420:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.916430:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578917376:0@lo:400: 00000100:00100000:1.0:1789265404.916451:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.916470:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376426dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578917888:0@lo:400: 00000100:00100000:1.0:1789265404.916499:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265404.916540:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578916608 00000100:00100000:1.0:1789265404.916550:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578916608 00000100:00100000:1.0:1789265404.916599:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578917120 00000100:00100000:1.0:1789265404.916602:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578917120 00000100:00100000:1.0:1789265404.916628:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578917632 00000100:00100000:1.0:1789265404.916631:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578917632 00000100:00100000:1.0:1789265404.916643:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578917248 00000100:00100000:1.0:1789265404.916645:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578917248 00000100:00100000:1.0:1789265404.916656:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578917760 00000100:00100000:1.0:1789265404.916659:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578917760 00000100:00100000:1.0:1789265404.916670:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578916864 00000100:00100000:1.0:1789265404.916672:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578916864 00000100:00100000:1.0:1789265404.916687:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265404.916696:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180578916608:12345-0@lo:400: 00000100:00100000:1.0:1789265404.916760:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180578916608:12345-0@lo:400: Request processed in 64us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.916767:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265404.916789:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789265404.916795:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180578917120:12345-0@lo:400: 00000100:00100000:1.0:1789265404.916822:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180578917120:12345-0@lo:400: Request processed in 28us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.916828:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789265404.916842:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789265404.916847:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876180578917632:12345-0@lo:400: 00000100:00100000:1.0:1789265404.916903:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876180578917632:12345-0@lo:400: Request processed in 55us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.916910:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789265404.916922:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789265404.916937:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578917248:12345-0@lo:400: 00000100:00100000:1.0:1789265404.916972:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578917248:12345-0@lo:400: Request processed in 35us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.916978:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789265404.916989:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789265404.916995:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578917760:12345-0@lo:400: 00000100:00100000:1.0:1789265404.917019:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578917760:12345-0@lo:400: Request processed in 25us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.917025:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789265404.917035:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789265404.917041:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578916864:12345-0@lo:400: 00000100:00100000:1.0:1789265404.917065:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578916864:12345-0@lo:400: Request processed in 24us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.917071:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789265404.917102:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578916992 00000100:00100000:1.0:1789265404.917107:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578916992 00000100:00100000:1.0:1789265404.917126:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578916736 00000100:00100000:1.0:1789265404.917128:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578916736 00000100:00100000:1.0:1789265404.917141:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265404.917147:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578916992:12345-0@lo:400: 00000100:00100000:1.0:1789265404.917181:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578916992:12345-0@lo:400: Request processed in 34us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.917187:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265404.917199:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265404.917205:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578916736:12345-0@lo:400: 00000100:00100000:1.0:1789265404.917231:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578916736:12345-0@lo:400: Request processed in 26us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.917245:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265404.917267:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578917504 00000100:00100000:1.0:1789265404.917270:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578917504 00000100:00100000:1.0:1789265404.917291:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578918016 00000100:00100000:1.0:1789265404.917306:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578918016 00000100:00100000:1.0:1789265404.917320:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578917376 00000100:00100000:1.0:1789265404.917323:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578917376 00000100:00100000:1.0:1789265404.917334:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578917888 00000100:00100000:1.0:1789265404.917336:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578917888 00000100:00100000:1.0:1789265404.917348:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265404.917355:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578917504:12345-0@lo:400: 00000100:00100000:1.0:1789265404.917402:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578917504:12345-0@lo:400: Request processed in 48us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.917409:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265404.917421:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265404.917427:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578918016:12345-0@lo:400: 00000100:00100000:1.0:1789265404.917456:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578918016:12345-0@lo:400: Request processed in 29us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.917462:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265404.917474:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265404.917480:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578917376:12345-0@lo:400: 00000100:00100000:1.0:1789265404.917506:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578917376:12345-0@lo:400: Request processed in 27us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.917513:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265404.917523:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789265404.917529:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578917888:12345-0@lo:400: 00000100:00100000:1.0:1789265404.917554:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578917888:12345-0@lo:400: Request processed in 26us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.917567:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1789265404.917610:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265404.917615:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265404.917618:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265404.917620:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265404.917664:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578916864:0@lo:400: 00010000:00080000:1.0:1789265404.917682:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2fd500 x1876180578917376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265404.917693:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578917376:0@lo:400: 00010000:00080000:1.0:1789265404.917704:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376426dca80 x1876180578917888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265404.917711:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376426dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578917888:0@lo:400: 00000100:00100000:1.0:1789265404.917721:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578916736:0@lo:400: 00010000:00080000:1.0:1789265404.917730:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2fea00 x1876180578917248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265404.917738:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578917248:0@lo:400: 00010000:00080000:1.0:1789265404.917749:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376426ddc00 x1876180578917760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265404.917758:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376426ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578917760:0@lo:400: 00000100:00100000:1.0:1789265404.917807:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578916992:0@lo:400: 00010000:00080000:1.0:1789265404.917819:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376426de300 x1876180578917504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265404.917827:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376426de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578917504:0@lo:400: 00010000:00080000:1.0:1789265404.917847:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376426dd500 x1876180578918016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265404.917854:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376426dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578918016:0@lo:400: 00000100:00100000:1.0:1789265404.917892:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180578916608:0@lo:400: 00000100:00100000:1.0:1789265404.917904:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180578917120:0@lo:400: 00000100:00100000:1.0:1789265404.917916:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376426dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876180578917632:0@lo:400: 00000100:00100000:1.0:1789265404.917976:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578916480 00000100:00100000:1.0:1789265404.917981:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578916480 00000100:00100000:1.0:1789265404.918016:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789265404.918023:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180578916480:12345-0@lo:400: 00000100:00100000:1.0:1789265404.918065:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180578916480:12345-0@lo:400: Request processed in 42us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265404.918072:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789265404.918107:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578916480:0@lo:400: 00000100:00100000:0.0:1789265405.431609:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578918144:0@lo:13: 00000100:00100000:2.0:1789265405.432378:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578918272:0@lo:13: 00000100:00100000:2.0:1789265405.435728:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265405.435856:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578918272 00000100:00100000:2.0:1789265405.435883:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578918272 00000100:00100000:2.0:1789265405.435942:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265405.435954:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578918272:12345-0@lo:13: 00002000:00000024:2.0:1789265405.435997:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265405.436058:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578918272:12345-0@lo:13: Request processed in 106us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265405.436066:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789265405.436121:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f15a300 x1876180578918272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265405.436143:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578918272:0@lo:13: 00000001:00100000:3.0:1789265405.437513:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f16c02c5-6a63-4180-875a-2aaaca684c23 00000100:00100000:0.0:1789265405.437770:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:3.0:1789265405.438258:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f16c02c5-6a63-4180-875a-2aaaca684c23 00000100:00100000:2.0:1789265405.445495:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578918144 00000100:00100000:2.0:1789265405.445518:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578918144 00000100:00100000:1.0:1789265405.445791:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265405.445805:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578918144:12345-0@lo:13: 00002000:00000024:1.0:1789265405.445843:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265405.448561:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578918144:12345-0@lo:13: Request processed in 2746us (10780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265405.448578:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789265405.448709:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642418000 x1876180578918144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265405.448740:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578918144:0@lo:13: 00010000:00010000:0.0:1789265405.491573:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265405.599091:0:10184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789265405.699182:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265405.699415:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265405.699451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265405.699495:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265405.699534:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265405.699572:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556845312 00000100:00100000:1.0:1789265405.699586:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556845312 00000100:00100000:1.0:1789265405.699780:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556845440 00000100:00100000:1.0:1789265405.699784:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556845440 00000100:00100000:1.0:1789265405.699817:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:1.0:1789265405.699828:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2397:x1876180556845312:12345-192.168.202.42@tcp:400: 00000100:00100000:1.0:1789265405.699953:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2397:x1876180556845312:12345-192.168.202.42@tcp:400: Request processed in 127us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265405.699961:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:1.0:1789265405.699983:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:1.0:1789265405.699989:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556845440:12345-192.168.202.42@tcp:400: 00000100:00100000:1.0:1789265405.700013:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556845440:12345-192.168.202.42@tcp:400: Request processed in 25us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265405.700019:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:1.0:1789265405.700037:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556845568 00000100:00100000:1.0:1789265405.700041:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556845568 00000100:00100000:1.0:1789265405.700067:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556845696 00000100:00100000:1.0:1789265405.700070:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556845696 00000100:00100000:1.0:1789265405.700091:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:1.0:1789265405.700098:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2397:x1876180556845568:12345-192.168.202.42@tcp:400: 00000100:00100000:1.0:1789265405.700123:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2397:x1876180556845568:12345-192.168.202.42@tcp:400: Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265405.700129:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:1.0:1789265405.700140:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:1.0:1789265405.700146:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556845696:12345-192.168.202.42@tcp:400: 00000100:00100000:1.0:1789265405.700178:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556845696:12345-192.168.202.42@tcp:400: Request processed in 32us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265405.700184:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00080000:1.0:1789265405.700468:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265405.700474:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265405.700477:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265405.700479:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265405.705839:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556845184 00000100:00100000:0.0:1789265405.705879:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556845184 00000100:00100000:0.0:1789265405.705994:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 202 00000100:00100000:0.0:1789265405.706010:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:2397:x1876180556845184:12345-192.168.202.42@tcp:400: 00000100:00100000:0.0:1789265405.706160:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:2397:x1876180556845184:12345-192.168.202.42@tcp:400: Request processed in 153us (6994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265405.706169:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 202 00000100:00100000:1.0:1789265406.452367:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376426dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578918400:0@lo:41: 00000100:00100000:1.0:1789265406.452483:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265406.452588:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578918400 00000100:00100000:1.0:1789265406.452599:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578918400 00000100:00100000:1.0:1789265406.452661:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789265406.452673:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578918400:12345-0@lo:41: 00000004:00000024:1.0:1789265406.452722:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789265406.452786:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578918400:12345-0@lo:41: Request processed in 115us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265406.452794:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789265406.452891:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376426dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578918400:0@lo:41: 00000100:00100000:3.0:1789265406.453237:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265406.453251:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578918528:0@lo:41: 00000100:00100000:3.0:1789265406.453304:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265406.453341:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578918528 00000100:00100000:3.0:1789265406.453345:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578918528 00000100:00100000:3.0:1789265406.453381:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265406.453390:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578918528:12345-0@lo:41: 00000004:00000024:3.0:1789265406.453411:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265406.453453:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578918528:12345-0@lo:41: Request processed in 65us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265406.453460:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265406.453497:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578918528:0@lo:41: 00000001:00100000:3.0:1789265406.456717:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f16c02c5-6a63-4180-875a-2aaaca684c23 00010000:00010000:1.0:1789265406.515982:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265406.968341:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265406.968370:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578918656:0@lo:13: 00000100:00100000:1.0:1789265406.968447:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265406.968557:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578918656 00000100:00100000:0.0:1789265406.968566:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578918656 00000100:00100000:0.0:1789265406.968623:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265406.968633:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578918656:12345-0@lo:13: 00002000:00000024:0.0:1789265406.968665:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265406.968713:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578918656:12345-0@lo:13: Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265406.968721:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789265406.968759:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642418000 x1876180578918656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265406.968778:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578918656:0@lo:13: 00000100:00080000:1.0:1789265406.968828:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265406.969451:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578918784:0@lo:13: 00000100:00100000:1.0:1789265406.969492:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265406.969693:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578918784 00000100:00100000:0.0:1789265406.969699:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578918784 00000100:00100000:0.0:1789265406.969746:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789265406.969753:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578918784:12345-0@lo:13: 00002000:00000024:0.0:1789265406.969768:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789265406.969819:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265406.970348:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578918784:12345-0@lo:13: Request processed in 593us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265406.970357:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789265406.970418:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f15a300 x1876180578918784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265406.970456:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578918784:0@lo:13: 00010000:00010000:0.0:1789265407.539306:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265408.563276:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265409.587725:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789265409.603036:0:10332:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc5ad5170 20000000:00000080:3.0:1789265409.604405:0:10332:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9377810bf000 uarg=0000000000000000 20000000:01000000:3.0:1789265409.604477:0:10332:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789265409.604480:0:10332:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789265409.604483:0:10332:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789265409.604489:0:10332:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789265409.604497:0:10332:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789265409.604604:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789265409.604607:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789265409.605791:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1789265409.606951:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1789265409.606993:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1789265409.607012:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1789265409.607026:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789265409.607029:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789265409.608027:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1789265409.609642:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1789265409.609689:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1789265409.609707:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1789265409.609722:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789265409.609725:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789265409.610407:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1789265409.610628:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1789265409.610651:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1789265409.610666:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1789265409.610676:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789265409.610678:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789265409.611176:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1789265409.611446:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1789265409.611483:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1789265409.611501:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1789265409.611515:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789265409.611517:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789265409.612277:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1789265409.612488:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1789265409.612512:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1789265409.612527:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:3.0:1789265409.612542:0:10332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789265409.612568:0:10332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.612590:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937782162800/0xbbfdc9019c1d38a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d38a2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.612599:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d38d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d38cc expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.612606:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bde00/0xbbfdc9019c1d3912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d390b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.612627:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93774167e200/0xbbfdc9019c1d3920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3919 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.612634:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93774167e400/0xbbfdc9019c1d392e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3927 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.612641:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d394a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3943 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.612649:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93774167f000/0xbbfdc9019c1d396d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3966 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.612656:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3989 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.612664:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93774167f600/0xbbfdc9019c1d39ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d39b3 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.612675:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937782162a00/0xbbfdc9019c1d39c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fdf expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.612683:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9376435fc800/0xbbfdc9019c1d39cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fe6 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.612692:0:10332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.612746:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9376435fc800/0xbbfdc9019c1d39cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fe6 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.612776:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9376435fc800/0xbbfdc9019c1d39cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fe6 expref: 9 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265409.612796:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578918912:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265409.613086:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937782162a00/0xbbfdc9019c1d39c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fdf expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.613096:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff937782162a00/0xbbfdc9019c1d39c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fdf expref: 9 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265409.613105:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919040:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265409.613161:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93774167f600/0xbbfdc9019c1d39ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d39b3 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.613170:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93774167f600/0xbbfdc9019c1d39ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d39b3 expref: 23 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265409.613180:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919168:0@lo:104: 00000100:00100000:3.0:1789265409.613231:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265409.613291:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3989 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.613300:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3990 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3989 expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265409.613309:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919296:0@lo:104: 00000100:00100000:3.0:1789265409.613332:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265409.613369:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93774167f000/0xbbfdc9019c1d396d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3966 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.613377:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93774167f000/0xbbfdc9019c1d396d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3966 expref: 23 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265409.613386:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919424:0@lo:104: 00000100:00100000:3.0:1789265409.613408:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265409.613447:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d394a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3943 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.613456:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d394a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3943 expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265409.613459:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578919168 00000100:00100000:2.0:1789265409.613473:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578919168 00000100:00100000:3.0:1789265409.613475:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919552:0@lo:104: 00000100:00100000:3.0:1789265409.613512:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265409.613537:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1789265409.613540:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93774167e400/0xbbfdc9019c1d392e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3927 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.613551:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93774167e400/0xbbfdc9019c1d392e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3927 expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265409.613552:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578919296 00000100:00100000:2.0:1789265409.613557:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578919296 00000100:00100000:3.0:1789265409.613574:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919680:0@lo:104: 00000100:00100000:2.0:1789265409.613575:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578919424 00000100:00100000:2.0:1789265409.613581:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578919424 00000100:00100000:2.0:1789265409.613595:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578919552 00000100:00100000:2.0:1789265409.613597:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578919552 00000100:00100000:3.0:1789265409.613613:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265409.613617:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789265409.613641:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93774167e200/0xbbfdc9019c1d3920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3919 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.613659:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93774167e200/0xbbfdc9019c1d3920 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3919 expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265409.613668:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919808:0@lo:104: 00000100:00100000:3.0:1789265409.613706:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265409.613725:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+6:10332:x1876180578919168:12345-0@lo:104: 00010000:00010000:3.0:1789265409.613734:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bde00/0xbbfdc9019c1d3912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d390b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.613743:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d39ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.613745:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377532bde00/0xbbfdc9019c1d3912 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d390b expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265409.613766:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919936:0@lo:104: 00000100:00100000:3.0:1789265409.613812:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265409.613827:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265409.613836:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+6:10332:x1876180578919168:12345-0@lo:104: Request processed in 117us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.613846:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265409.613895:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578919680 00000100:00100000:2.0:1789265409.613899:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578919680 00000100:00100000:2.0:1789265409.613911:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578919808 00000100:00100000:2.0:1789265409.613913:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578919808 00000100:00100000:2.0:1789265409.613921:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578919936 00000100:00100000:2.0:1789265409.613924:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578919936 00000100:00100000:2.0:1789265409.613934:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265409.613940:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+8:10332:x1876180578919296:12345-0@lo:104: 00010000:00010000:2.0:1789265409.613949:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3990 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.613998:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265409.614004:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+8:10332:x1876180578919296:12345-0@lo:104: Request processed in 64us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.614010:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265409.614024:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265409.614030:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+7:10332:x1876180578919424:12345-0@lo:104: 00010000:00010000:2.0:1789265409.614038:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d396d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.614066:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789265409.614077:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+7:10332:x1876180578919424:12345-0@lo:104: Request processed in 48us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.614084:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265409.614101:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265409.614108:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+6:10332:x1876180578919552:12345-0@lo:104: 00010000:00010000:2.0:1789265409.614118:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d394a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.614146:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789265409.614150:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+6:10332:x1876180578919552:12345-0@lo:104: Request processed in 44us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.614156:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265409.614194:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265409.614200:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+5:10332:x1876180578919680:12345-0@lo:104: 00010000:00010000:2.0:1789265409.614208:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d392e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.614259:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789265409.614265:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+5:10332:x1876180578919680:12345-0@lo:104: Request processed in 66us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.614271:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265409.614284:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789265409.614290:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+4:10332:x1876180578919808:12345-0@lo:104: 00010000:00010000:2.0:1789265409.614298:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3920 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.614525:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789265409.614537:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+4:10332:x1876180578919808:12345-0@lo:104: Request processed in 247us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.614543:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789265409.614556:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265409.614562:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:10332:x1876180578919936:12345-0@lo:104: 00010000:00010000:2.0:1789265409.614570:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3912 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.614598:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00010000:00010000:3.0:1789265409.614599:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d38d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d38cc expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265409.614608:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:10332:x1876180578919936:12345-0@lo:104: Request processed in 45us (801us total) trans 0 rc 0/0 00010000:00010000:3.0:1789265409.614619:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d38d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d38cc expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265409.614620:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789265409.614637:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578920064:0@lo:104: 00000100:00100000:3.0:1789265409.614668:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265409.614717:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937782162800/0xbbfdc9019c1d38a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d38a2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.614726:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937782162800/0xbbfdc9019c1d38a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d38a2 expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265409.614728:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578920064 00000100:00100000:2.0:1789265409.614737:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578920064 00000100:00100000:3.0:1789265409.614740:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578920192:0@lo:104: 00000100:00100000:2.0:1789265409.614764:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265409.614773:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:10332:x1876180578920064:12345-0@lo:104: 00000100:00100000:3.0:1789265409.614782:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265409.614784:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d38d3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265409.614804:0:10332:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf480 going to sleep for 11 seconds 00010000:00010000:2.0:1789265409.614824:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1789265409.614831:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:10332:x1876180578920064:12345-0@lo:104: Request processed in 60us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.614837:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265409.614848:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578920192 00000100:00100000:2.0:1789265409.614852:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578920192 00000100:00100000:2.0:1789265409.614884:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265409.614890:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:10332:x1876180578920192:12345-0@lo:104: 00010000:00010000:2.0:1789265409.614898:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d38a9 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.614933:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1789265409.614939:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:10332:x1876180578920192:12345-0@lo:104: Request processed in 49us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.614944:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1789265409.614965:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1789265409.615037:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d39ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615047:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643218400 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265409.615053:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d39ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615063:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d39ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265409.615071:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d39ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265409.615079:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265409.615120:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d39ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615127:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265409.615159:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d39ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615166:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937643218400/0xbbfdc9019c1d39b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d39ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615194:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1789265409.615197:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3990 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615203:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc200 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265409.615206:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3990 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615213:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3990 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265409.615283:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3990 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265409.615291:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265409.615372:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3990 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615380:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265409.615408:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3990 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615416:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d3989 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3990 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615428:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789265409.615432:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d396d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265409.615436:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578920448:0@lo:103: 00010000:00010000:2.0:1789265409.615454:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643219a00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265409.615458:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d396d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615466:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d396d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265409.615473:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d396d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265409.615480:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789265409.615496:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265409.615504:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d396d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615512:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265409.615519:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d396d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615526:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937643219a00/0xbbfdc9019c1d3966 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d396d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615538:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789265409.615542:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d394a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615548:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fc400 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265409.615552:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d394a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265409.615555:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265409.615571:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578920576:0@lo:103: 00010000:00010000:2.0:1789265409.615575:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d394a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265409.615584:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d394a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265409.615590:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789265409.615606:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265409.615607:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d394a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.615615:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265409.615622:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d394a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265409.615648:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578920448 00000100:00100000:0.0:1789265409.615660:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578920448 00010000:00010000:0.0:1789265409.615692:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3990 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3989 expref: 24 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265409.615725:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578920576 00000100:00100000:0.0:1789265409.615728:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578920576 00010000:00010000:0.0:1789265409.615746:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93774167f000/0xbbfdc9019c1d396d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3966 expref: 25 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265409.615761:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265409.615771:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f67c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+25:3645:x1876180578920448:12345-0@lo:103: 00010000:00010000:0.0:1789265409.615781:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265409.615785:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3990 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3989 expref: 25 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265409.615792:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3990 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3989 expref: 25 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265409.615813:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265409.615874:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f67c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+25:3645:x1876180578920448:12345-0@lo:103: Request processed in 93us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265409.615879:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265409.615933:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265409.615938:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642418000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578920576:12345-0@lo:103: 00010000:00010000:2.0:1789265409.615941:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377413fc400/0xbbfdc9019c1d3943 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d394a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265409.615943:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265409.615947:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93774167f000/0xbbfdc9019c1d396d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3966 expref: 24 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265409.615958:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93774167f000/0xbbfdc9019c1d396d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3966 expref: 24 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265409.615965:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265409.615983:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642418000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578920576:12345-0@lo:103: Request processed in 41us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265409.615987:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265409.616026:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578920576:0@lo:103: 00000100:00100000:0.0:1789265409.616032:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578920448:0@lo:103: 00010000:00010000:2.0:1789265409.616245:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789265409.616250:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d392e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616264:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bca00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265409.616268:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d392e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616275:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d392e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265409.616281:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d392e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265409.616297:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265409.616458:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d392e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616465:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265409.616472:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d392e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616479:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3927 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d392e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616490:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789265409.616493:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3920 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616499:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc400 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265409.616502:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3920 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616509:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3920 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265409.616517:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3920 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265409.616522:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265409.616534:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3920 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616540:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265409.616568:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3920 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616575:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bc400/0xbbfdc9019c1d3919 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3920 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616585:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789265409.616589:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3912 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616596:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bce00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265409.616600:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3912 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616607:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3912 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265409.616614:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919168:0@lo:104: 10000000:00010000:2.0:1789265409.616617:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3912 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265409.616626:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265409.616636:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3990 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3989 expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616651:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3912 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616661:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789265409.616662:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919296:0@lo:104: 00010000:00010000:2.0:1789265409.616670:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3912 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616679:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d390b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3912 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.616681:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93774167f000/0xbbfdc9019c1d396d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3966 expref: 22 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616704:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789265409.616705:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919424:0@lo:104: 00000100:00100000:3.0:1789265409.616714:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919552:0@lo:104: 00010000:00010000:2.0:1789265409.616717:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d38d3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265409.616722:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919680:0@lo:104: 00010000:00010000:2.0:1789265409.616731:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fd200 already unused, calling callback (ffffffffc13cbc20) 00000100:00100000:3.0:1789265409.616738:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919808:0@lo:104: 10000000:00010000:2.0:1789265409.616738:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d38d3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616749:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d38d3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265409.616757:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919936:0@lo:104: 10000000:00010000:2.0:1789265409.616757:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d38d3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265409.616769:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578920064:0@lo:104: 10000000:01000000:2.0:1789265409.616769:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789265409.616782:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578920192:0@lo:104: 00010000:00010000:2.0:1789265409.616789:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d38d3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616797:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265409.616802:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d38d3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616808:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377413fd200/0xbbfdc9019c1d38cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d38d3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616821:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265409.616824:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d38a9 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616830:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fc800 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265409.616832:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d38a9 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.616849:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d38a9 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265409.616856:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d38a9 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265409.617037:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265409.617055:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d38a9 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.617061:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265409.617066:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d38a9 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.617072:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377413fc800/0xbbfdc9019c1d38a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d38a9 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.617089:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265409.617091:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265409.617093:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265409.617104:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265409.617123:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578920320:0@lo:103: 00000100:00100000:2.0:1789265409.617179:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265409.617227:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578920832:0@lo:103: 00000100:00100000:2.0:1789265409.617249:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265409.617279:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578921344:0@lo:103: 00000100:00100000:2.0:1789265409.617300:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265409.617674:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789265409.617692:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578920704:0@lo:103: 00000100:00100000:2.0:1789265409.617716:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265409.617735:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578921216:0@lo:103: 00000100:00100000:2.0:1789265409.617753:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265409.617779:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578921088:0@lo:103: 00000100:00100000:2.0:1789265409.617807:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265409.617810:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578920320 00000100:00100000:3.0:1789265409.617818:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578920320 00000100:00100000:2.0:1789265409.617831:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265409.617839:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578920960:0@lo:103: 00000100:00100000:2.0:1789265409.617880:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265409.617902:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578920832 00000100:00100000:2.0:1789265409.617906:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578920832 00010000:00010000:2.0:1789265409.617937:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93774167e400/0xbbfdc9019c1d392e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3927 expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265409.617964:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578921344 00000100:00100000:2.0:1789265409.617967:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578921344 00010000:00010000:2.0:1789265409.617996:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937782162800/0xbbfdc9019c1d38a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d38a2 expref: 24 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265409.618007:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578920704 00000100:00100000:2.0:1789265409.618009:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578920704 00010000:00010000:2.0:1789265409.618018:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d394a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3943 expref: 25 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265409.618027:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578921216 00000100:00100000:2.0:1789265409.618029:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578921216 00010000:00010000:2.0:1789265409.618037:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d38d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d38cc expref: 26 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265409.618046:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578921088 00000100:00100000:2.0:1789265409.618055:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578921088 00010000:00010000:2.0:1789265409.618068:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bde00/0xbbfdc9019c1d3912 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d390b expref: 27 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265409.618079:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578920960 00000100:00100000:2.0:1789265409.618082:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578920960 00010000:00010000:2.0:1789265409.618092:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93774167e200/0xbbfdc9019c1d3920 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3919 expref: 28 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265409.618107:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265409.618116:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+28:3644:x1876180578920832:12345-0@lo:103: 00010000:00010000:2.0:1789265409.618131:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265409.618138:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93774167e400/0xbbfdc9019c1d392e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3927 expref: 28 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618152:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93774167e400/0xbbfdc9019c1d392e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3927 expref: 28 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618169:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93774167e400/0xbbfdc9019c1d392e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3927 expref: 28 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618188:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265409.618228:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+27:3644:x1876180578920832:12345-0@lo:103: Request processed in 114us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.618236:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265409.618266:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265409.618272:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+26:3644:x1876180578921344:12345-0@lo:103: 00010000:00010000:2.0:1789265409.618281:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265409.618286:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937782162800/0xbbfdc9019c1d38a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d38a2 expref: 26 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618305:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937782162800/0xbbfdc9019c1d38a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d38a2 expref: 26 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618330:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937782162800/0xbbfdc9019c1d38a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d38a2 expref: 26 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618342:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265409.618368:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+25:3644:x1876180578921344:12345-0@lo:103: Request processed in 96us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.618375:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265409.618392:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265409.618401:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578920704:12345-0@lo:103: 00010000:00010000:2.0:1789265409.618410:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265409.618416:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d394a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3943 expref: 24 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618427:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d394a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3943 expref: 24 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618441:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377413fde00/0xbbfdc9019c1d394a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3943 expref: 24 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618455:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265409.618488:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+23:3644:x1876180578920704:12345-0@lo:103: Request processed in 89us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.618497:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265409.618519:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789265409.618528:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+22:3644:x1876180578921216:12345-0@lo:103: 00010000:00010000:2.0:1789265409.618544:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265409.618550:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d38d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d38cc expref: 22 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618560:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d38d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d38cc expref: 22 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618574:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d38d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d38cc expref: 22 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618587:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265409.618619:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+21:3644:x1876180578921216:12345-0@lo:103: Request processed in 92us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.618627:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789265409.618650:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265409.618660:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f67fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+20:3646:x1876180578921088:12345-0@lo:103: 00010000:00010000:2.0:1789265409.618669:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265409.618675:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bde00/0xbbfdc9019c1d3912 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d390b expref: 20 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618685:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bde00/0xbbfdc9019c1d3912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d390b expref: 20 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618700:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bde00/0xbbfdc9019c1d3912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d390b expref: 20 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618713:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265409.618753:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f67fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+19:3646:x1876180578921088:12345-0@lo:103: Request processed in 94us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.618761:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265409.618792:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265409.618800:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+18:3646:x1876180578920960:12345-0@lo:103: 00010000:00010000:2.0:1789265409.618809:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265409.618815:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93774167e200/0xbbfdc9019c1d3920 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3919 expref: 18 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618825:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93774167e200/0xbbfdc9019c1d3920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3919 expref: 18 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618837:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93774167e200/0xbbfdc9019c1d3920 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3919 expref: 18 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.618850:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265409.618906:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+17:3646:x1876180578920960:12345-0@lo:103: Request processed in 107us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.618915:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265409.619001:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578920960:0@lo:103: 00000100:00100000:2.0:1789265409.619019:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578921088:0@lo:103: 00000100:00100000:2.0:1789265409.619074:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578920704:0@lo:103: 00000100:00100000:2.0:1789265409.619089:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578921216:0@lo:103: 00000100:00100000:2.0:1789265409.619106:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578920832:0@lo:103: 00000100:00100000:2.0:1789265409.619121:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578921344:0@lo:103: 00010000:00010000:3.0:1789265409.619216:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93774167f600/0xbbfdc9019c1d39ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d39b3 expref: 16 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265409.619306:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789265409.619312:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642667100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+16:3644:x1876180578920320:12345-0@lo:103: 00010000:00010000:3.0:1789265409.619320:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265409.619323:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93774167f600/0xbbfdc9019c1d39ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d39b3 expref: 16 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.619331:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93774167f600/0xbbfdc9019c1d39ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d39b3 expref: 16 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.619342:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93774167f600/0xbbfdc9019c1d39ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d39b3 expref: 16 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.619363:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265409.619395:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642667100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+15:3644:x1876180578920320:12345-0@lo:103: Request processed in 84us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265409.619400:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265409.620073:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578920320:0@lo:103: 00000100:00100000:2.0:1789265409.623624:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578918912:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265409.623644:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876180578919040:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265409.623718:0:10332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265409.625421:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265409.625474:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265409.625512:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556845824 00000100:00100000:2.0:1789265409.625512:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556845952 00000100:00100000:3.0:1789265409.625526:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556845824 00000100:00100000:2.0:1789265409.625527:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556845952 00010000:00010000:2.0:1789265409.625580:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937782162a00/0xbbfdc9019c1d39c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fdf expref: 11 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.625583:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9376435fc800/0xbbfdc9019c1d39cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fe6 expref: 11 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265409.625641:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:2.0:1789265409.625650:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:3.0:1789265409.625656:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:63f6cd89-abac-4801-8de9-f59ae281263f+11:2400:x1876180556845952:12345-192.168.202.42@tcp:103: 00000100:00100000:2.0:1789265409.625664:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63f6cd89-abac-4801-8de9-f59ae281263f+11:2400:x1876180556845824:12345-192.168.202.42@tcp:103: 00010000:00010000:3.0:1789265409.625675:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265409.625677:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265409.625685:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937782162a00/0xbbfdc9019c1d39c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fdf expref: 11 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.625686:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9376435fc800/0xbbfdc9019c1d39cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fe6 expref: 11 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.625718:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937782162a00/0xbbfdc9019c1d39c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fdf expref: 11 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.626067:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9376435fc800/0xbbfdc9019c1d39cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fe6 expref: 11 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.626091:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9376435fc800/0xbbfdc9019c1d39cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fe6 expref: 11 pid: 6512 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.626112:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265409.626188:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63f6cd89-abac-4801-8de9-f59ae281263f+10:2400:x1876180556845824:12345-192.168.202.42@tcp:103: Request processed in 528us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265409.626198:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 34 00010000:00010000:3.0:1789265409.628243:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937782162a00/0xbbfdc9019c1d39c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d918fdf expref: 9 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.628675:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.628686:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.628716:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.628741:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.628747:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.628754:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.628762:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643219600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265409.628766:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.628775:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.628799:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265409.628813:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265409.628960:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:63f6cd89-abac-4801-8de9-f59ae281263f+8:2400:x1876180556845952:12345-192.168.202.42@tcp:103: Request processed in 3304us (3479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265409.628972:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 33 00010000:00010000:2.0:1789265409.628987:0:10332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.629011:0:10332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265409.629019:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3a0e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265410.035404:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578921600:0@lo:400: 00000100:00100000:2.0:1789265410.036219:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.036343:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180578922112:0@lo:400: 00000100:00100000:2.0:1789265410.036390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.036417:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180578922624:0@lo:400: 00000100:00100000:2.0:1789265410.036440:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.036483:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789265410.036501:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180578921472:0@lo:400: 00000100:00100000:2.0:1789265410.036529:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.036756:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180578921984:0@lo:400: 00000100:00100000:2.0:1789265410.036777:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.036797:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876180578922496:0@lo:400: 00000100:00100000:2.0:1789265410.036812:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.036847:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578921856:0@lo:400: 00000100:00100000:2.0:1789265410.036897:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.036914:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578922368:0@lo:400: 00000100:00100000:2.0:1789265410.036933:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.036944:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578922880:0@lo:400: 00000100:00100000:3.0:1789265410.037103:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578921600 00000100:00100000:3.0:1789265410.037116:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578921600 00000100:00100000:3.0:1789265410.037170:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578921856 00000100:00100000:3.0:1789265410.037174:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578921856 00000100:00100000:3.0:1789265410.037190:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265410.037198:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578921600:12345-0@lo:400: 00000100:00100000:3.0:1789265410.037312:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578921600:12345-0@lo:400: Request processed in 113us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.037329:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265410.037347:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265410.037352:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578921856:12345-0@lo:400: 00000100:00100000:3.0:1789265410.037373:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578921856:12345-0@lo:400: Request processed in 22us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.037377:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265410.037413:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578922112 00000100:00100000:3.0:1789265410.037415:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578922112 00000100:00100000:3.0:1789265410.037441:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578922624 00000100:00100000:3.0:1789265410.037443:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578922624 00000100:00100000:3.0:1789265410.037453:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578921472 00000100:00100000:3.0:1789265410.037454:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578921472 00000100:00100000:3.0:1789265410.037461:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578921984 00000100:00100000:3.0:1789265410.037463:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578921984 00000100:00100000:3.0:1789265410.037471:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578922496 00000100:00100000:3.0:1789265410.037472:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578922496 00000100:00100000:3.0:1789265410.037491:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265410.037498:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180578922112:12345-0@lo:400: 00000100:00100000:3.0:1789265410.037539:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180578922112:12345-0@lo:400: Request processed in 41us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265410.037811:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.037857:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578921856:0@lo:400: 00000100:00100000:2.0:1789265410.037904:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789265410.037912:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578921728:0@lo:400: 00000100:00100000:2.0:1789265410.037931:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.037940:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578922240:0@lo:400: 00000100:00100000:3.0:1789265410.038028:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265410.038040:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578921728 00000100:00100000:3.0:1789265410.038043:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578921728 00000100:00100000:3.0:1789265410.038057:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789265410.038061:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180578922624:12345-0@lo:400: 00000100:00100000:3.0:1789265410.038092:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180578922624:12345-0@lo:400: Request processed in 29us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.038104:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789265410.038116:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265410.038122:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180578921472:12345-0@lo:400: 00000100:00100000:3.0:1789265410.038151:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180578921472:12345-0@lo:400: Request processed in 29us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.038157:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265410.038168:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265410.038175:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180578921984:12345-0@lo:400: 00000100:00100000:3.0:1789265410.038198:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180578921984:12345-0@lo:400: Request processed in 25us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.038202:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265410.038209:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265410.038213:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876180578922496:12345-0@lo:400: 00000100:00100000:3.0:1789265410.038234:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876180578922496:12345-0@lo:400: Request processed in 20us (1420us total) trans 0 rc 0/0 00000100:00080000:0.0:1789265410.038388:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265410.038394:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265410.038421:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180578921472:0@lo:400: 00000100:00100000:0.0:1789265410.038433:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180578921984:0@lo:400: 00000100:00100000:0.0:1789265410.038444:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876180578922496:0@lo:400: 00000100:00100000:0.0:1789265410.038457:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578921600:0@lo:400: 00010000:00080000:0.0:1789265410.038473:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36ed80 x1876180578922112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265410.038765:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180578922112:0@lo:400: 00010000:00080000:0.0:1789265410.038780:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36d880 x1876180578922624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265410.038786:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180578922624:0@lo:400: 00000100:00100000:2.0:1789265410.038911:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.038930:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578922752:0@lo:400: 00000100:00100000:3.0:1789265410.039085:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789265410.039169:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578922368 00000100:00100000:0.0:1789265410.039175:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578922368 00000100:00100000:0.0:1789265410.039215:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578922880 00000100:00100000:0.0:1789265410.039218:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578922880 00000100:00100000:0.0:1789265410.039231:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578922240 00000100:00100000:0.0:1789265410.039234:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578922240 00000100:00100000:0.0:1789265410.039267:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265410.039275:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578922368:12345-0@lo:400: 00000100:00100000:0.0:1789265410.039336:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578922368:12345-0@lo:400: Request processed in 61us (2400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.039342:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265410.039355:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265410.039360:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578922880:12345-0@lo:400: 00000100:00100000:0.0:1789265410.039382:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578922880:12345-0@lo:400: Request processed in 23us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.039386:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265410.039392:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265410.039396:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578922240:12345-0@lo:400: 00000100:00100000:0.0:1789265410.039410:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578922240:12345-0@lo:400: Request processed in 14us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.039414:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265410.039454:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789265410.039503:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36ca80 x1876180578922368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265410.039523:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578922368:0@lo:400: 00010000:00080000:2.0:1789265410.039537:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642667100 x1876180578922880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265410.039552:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578922880:0@lo:400: 00010000:00080000:2.0:1789265410.039571:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36d500 x1876180578922240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265410.039579:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578922240:0@lo:400: 00000100:00100000:2.0:1789265410.039598:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578922752 00000100:00100000:2.0:1789265410.039602:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578922752 00000100:00100000:2.0:1789265410.039626:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265410.039632:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578922752:12345-0@lo:400: 00000100:00100000:2.0:1789265410.039673:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578922752:12345-0@lo:400: Request processed in 42us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265410.039686:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789265410.039706:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36fb80 x1876180578922752/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265410.039713:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578922752:0@lo:400: 00000100:00100000:1.0:1789265410.042893:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789265410.042931:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578921728:12345-0@lo:400: 00000100:00100000:1.0:1789265410.043104:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578921728:12345-0@lo:400: Request processed in 195us (5170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265410.043114:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789265410.043232:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578921728:0@lo:400: 00000100:00080000:1.0:1789265410.044427:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265410.044439:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265410.548046:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578923008:0@lo:13: 00000100:00100000:1.0:1789265410.548167:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265410.548280:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265410.548289:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578923136:0@lo:13: 00000100:00100000:1.0:1789265410.548327:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.548925:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578923008 00000100:00100000:0.0:1789265410.548938:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578923008 00000100:00100000:0.0:1789265410.548995:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578923136 00000100:00100000:0.0:1789265410.548999:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578923136 00000100:00100000:0.0:1789265410.549021:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265410.549034:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578923008:12345-0@lo:13: 00002000:00000024:0.0:1789265410.549073:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265410.549161:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578923008:12345-0@lo:13: Request processed in 129us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.549169:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265410.549189:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265410.549196:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578923136:12345-0@lo:13: 00002000:00000024:0.0:1789265410.549208:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265410.549233:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578923136:12345-0@lo:13: Request processed in 38us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.549239:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789265410.549760:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642418000 x1876180578923136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265410.549786:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578923136:0@lo:13: 00010000:00080000:1.0:1789265410.549804:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36fb80 x1876180578923008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265410.549817:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578923008:0@lo:13: 00010000:00010000:2.0:1789265410.612966:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265410.674975:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789265410.674986:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff937641a6a800 from 48 10000000:01000000:2.0:1789265410.674994:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265410.675057:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.675068:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.675079:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265410.675104:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578923264:0@lo:101: 00000100:00100000:2.0:1789265410.675200:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.675414:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578923264 00000100:00100000:0.0:1789265410.675425:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578923264 00000100:00100000:0.0:1789265410.675496:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789265410.675506:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+15:6516:x1876180578923264:12345-0@lo:101: 00010000:00010000:0.0:1789265410.675525:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265410.675734:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937642393e00/0xbbfdc9019c1d3a1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3a15 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.675764:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642393e00/0xbbfdc9019c1d3a1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a15 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.675774:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937642393e00/0xbbfdc9019c1d3a1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a15 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.675806:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393e00, rc 0) 00000100:00100000:0.0:1789265410.675850:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578923264:12345-0@lo:101: Request processed in 347us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.675855:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789265410.677407:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f1516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265410.677455:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578923264:0@lo:101: 00010000:00010000:2.0:1789265410.677489:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a1c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.677500:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a1c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265410.677683:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578923392:0@lo:501: 00000100:00100000:2.0:1789265410.677757:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.677880:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578923392 00000100:00100000:0.0:1789265410.677886:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578923392 00000100:00100000:0.0:1789265410.677923:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789265410.677929:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578923392:12345-0@lo:501: 00000100:00100000:0.0:1789265410.678076:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578923392:12345-0@lo:501: Request processed in 146us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.678082:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789265410.681731:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f1516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265410.681796:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578923392:0@lo:501: 00000100:00100000:2.0:1789265410.682646:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578923520:0@lo:503: 00000100:00100000:2.0:1789265410.682770:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.686531:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f1516c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.687592:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578923520 00000100:00100000:0.0:1789265410.687610:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578923520 00000100:00100000:0.0:1789265410.687839:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789265410.687854:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578923520:12345-0@lo:503: 00000100:00100000:0.0:1789265410.688166:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578923520:12345-0@lo:503: Request processed in 315us (5396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.688175:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789265410.688480:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578923520:0@lo:503: 00000100:00100000:2.0:1789265410.689475:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10349:1876180578923648:0@lo:502: 00000100:00100000:2.0:1789265410.689560:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.689954:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f151180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265410.690038:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578923648 00000100:00100000:1.0:1789265410.690056:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578923648 00000100:00100000:1.0:1789265410.690124:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789265410.690135:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:10349:x1876180578923648:12345-0@lo:502: 00000100:00100000:1.0:1789265410.690533:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+16:10349:x1876180578923648:12345-0@lo:502: Request processed in 399us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265410.690543:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789265410.690775:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10349:1876180578923648:0@lo:502: 00000100:00100000:2.0:1789265410.690852:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10349:1876180578923776:0@lo:502: 00000100:00100000:2.0:1789265410.690921:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.691013:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f151180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.691238:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578923776 00000100:00100000:0.0:1789265410.691254:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578923776 00000100:00100000:0.0:1789265410.691293:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789265410.691302:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:10349:x1876180578923776:12345-0@lo:502: 00000100:00100000:0.0:1789265410.691401:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:10349:x1876180578923776:12345-0@lo:502: Request processed in 99us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.691409:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789265410.691833:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10349:1876180578923776:0@lo:502: 00000040:00080000:2.0:1789265410.691897:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789265410.692688:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789265410.692720:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265410.692736:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a1c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.692750:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a1c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265410.692762:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789265410.692766:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789265410.692770:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789265410.692814:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.692824:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.692837:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265410.692897:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578923904:0@lo:101: 00000100:00100000:0.0:1789265410.692967:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.693020:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e72c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265410.693274:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578923904 00000100:00100000:1.0:1789265410.693283:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578923904 00000100:00100000:1.0:1789265410.693340:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789265410.693351:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+16:6516:x1876180578923904:12345-0@lo:101: 00010000:00010000:1.0:1789265410.693367:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265410.693385:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bce00/0xbbfdc9019c1d3a2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3a23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.693416:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bce00/0xbbfdc9019c1d3a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a23 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.693428:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bce00/0xbbfdc9019c1d3a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a23 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.693437:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bce00, rc 0) 00000100:00100000:1.0:1789265410.693488:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578923904:12345-0@lo:101: Request processed in 139us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265410.693495:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789265410.693892:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578923904:0@lo:101: 00010000:00010000:2.0:1789265410.693909:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.693919:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265410.694020:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578924032:0@lo:501: 00000100:00100000:2.0:1789265410.694437:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.694474:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f151180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.694827:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578924032 00000100:00100000:0.0:1789265410.694834:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578924032 00000100:00100000:0.0:1789265410.694916:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789265410.694926:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578924032:12345-0@lo:501: 00000100:00100000:0.0:1789265410.695356:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578924032:12345-0@lo:501: Request processed in 431us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.695365:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789265410.695536:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578924032:0@lo:501: 00000100:00100000:2.0:1789265410.695584:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578924160:0@lo:503: 00000100:00100000:2.0:1789265410.695637:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.695663:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f151180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.695934:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578924160 00000100:00100000:0.0:1789265410.695939:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578924160 00000100:00100000:2.0:1789265410.698402:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789265410.698435:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578924160:12345-0@lo:503: 00000100:00100000:2.0:1789265410.699108:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578924160:12345-0@lo:503: Request processed in 688us (3467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265410.699129:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789265410.699532:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578924160:0@lo:503: 00000100:00100000:0.0:1789265410.700438:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10350:1876180578924288:0@lo:502: 00000100:00100000:0.0:1789265410.700539:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.700589:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377455370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265410.700823:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578924288 00000100:00100000:1.0:1789265410.700832:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578924288 00000100:00100000:1.0:1789265410.700905:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789265410.700916:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:10350:x1876180578924288:12345-0@lo:502: 00000100:00100000:1.0:1789265410.701108:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+17:10350:x1876180578924288:12345-0@lo:502: Request processed in 194us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.701368:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10350:1876180578924288:0@lo:502: 00000020:01000000:3.0:1789265410.701404:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265410.701416:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265410.701420:0:10350:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789265410.701427:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789265410.701459:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10350:1876180578924416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265410.701511:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265410.701542:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578924416 00000100:00100000:3.0:1789265410.701546:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578924416 00000100:00100000:3.0:1789265410.701579:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789265410.701585:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:10350:x1876180578924416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265410.701661:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:10350:x1876180578924416:12345-0@lo:502:llog_process_th.0 Request processed in 75us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.701669:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789265410.701733:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.701745:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10350:1876180578924416:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265410.701762:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265410.701767:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265410.701768:0:10350:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789265410.701772:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000100:00100000:1.0:1789265410.702365:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000020:01000000:2.0:1789265410.702493:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789265410.702534:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789265410.702549:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.702562:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265410.702574:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789265410.702577:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93777aaec000 from 48 10000000:01000000:2.0:1789265410.702580:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265410.702613:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.702622:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.702646:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265410.702668:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578924544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.702725:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.702764:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f151000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.703092:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578924544 00000100:00100000:3.0:1789265410.703100:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578924544 00000100:00100000:3.0:1789265410.703270:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789265410.703279:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+17:6516:x1876180578924544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265410.703293:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265410.703309:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937643219e00/0xbbfdc9019c1d3a38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3a31 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.703337:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643219e00/0xbbfdc9019c1d3a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a31 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.703350:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937643219e00/0xbbfdc9019c1d3a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a31 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.703362:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219e00, rc 0) 00000100:00100000:3.0:1789265410.703411:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578924544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.703431:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789265410.704379:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578924544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265410.704406:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a38 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.704419:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a38 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265410.704524:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578924672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.704578:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.704623:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.705369:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578924672 00000100:00100000:3.0:1789265410.705380:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578924672 00000100:00100000:3.0:1789265410.705449:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789265410.705459:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578924672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.705659:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578924672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.705668:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789265410.706364:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578924672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265410.706429:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578924800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265410.706505:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265410.706551:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.706649:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578924800 00000100:00100000:3.0:1789265410.706654:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578924800 00000100:00100000:3.0:1789265410.706690:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789265410.706697:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578924800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.706789:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578924800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.706794:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789265410.707191:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578924800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265410.707593:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10351:1876180578924928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265410.707641:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265410.707680:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.707758:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578924928 00000100:00100000:3.0:1789265410.707762:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578924928 00000100:00100000:3.0:1789265410.707792:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789265410.707798:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+18:10351:x1876180578924928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265410.707952:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+18:10351:x1876180578924928:12345-0@lo:502:llog_process_th.0 Request processed in 154us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.707957:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789265410.708232:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10351:1876180578924928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265410.708293:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10351:1876180578925056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265410.708327:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265410.708357:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.708404:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578925056 00000100:00100000:3.0:1789265410.708408:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578925056 00000100:00100000:3.0:1789265410.708442:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789265410.708450:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:10351:x1876180578925056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265410.708620:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+18:10351:x1876180578925056:12345-0@lo:502:llog_process_th.0 Request processed in 170us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.708627:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789265410.708704:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10351:1876180578925056:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789265410.708720:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789265410.709018:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789265410.709040:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789265410.709050:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a38 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.709066:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a38 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265410.709075:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789265410.709078:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789265410.709080:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789265410.709190:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.709198:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.709208:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265410.709223:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578925184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.709271:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265410.709305:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.709357:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578925184 00000100:00100000:0.0:1789265410.709363:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578925184 00000100:00100000:0.0:1789265410.709405:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789265410.709413:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+18:6516:x1876180578925184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265410.709426:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265410.709443:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937642392a00/0xbbfdc9019c1d3a46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3a3f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.709471:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642392a00/0xbbfdc9019c1d3a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a3f expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.709483:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937642392a00/0xbbfdc9019c1d3a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a3f expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.709514:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392a00, rc 0) 00000100:00100000:0.0:1789265410.709557:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+19:6516:x1876180578925184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.709564:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789265410.709778:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578925184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265410.709789:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a46 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.709802:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a46 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265410.709849:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578925312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.709890:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265410.709909:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.709999:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578925312 00000100:00100000:0.0:1789265410.710002:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578925312 00000100:00100000:0.0:1789265410.710025:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789265410.710030:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+19:6516:x1876180578925312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.710187:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+19:6516:x1876180578925312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.710192:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789265410.710312:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578925312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.710341:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578925440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.710385:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265410.710413:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.710774:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578925440 00000100:00100000:0.0:1789265410.710778:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578925440 00000100:00100000:0.0:1789265410.710804:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789265410.710808:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+19:6516:x1876180578925440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.710910:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+19:6516:x1876180578925440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.710915:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789265410.711109:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578925440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.711656:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10352:1876180578925568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265410.711762:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265410.711825:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.713275:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578925568 00000100:00100000:0.0:1789265410.713292:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578925568 00000100:00100000:0.0:1789265410.713373:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789265410.713385:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+19:10352:x1876180578925568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265410.713623:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+19:10352:x1876180578925568:12345-0@lo:502:llog_process_th.0 Request processed in 240us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.713632:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789265410.713937:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10352:1876180578925568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265410.713996:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265410.714010:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265410.714014:0:10352:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789265410.714031:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789265410.714092:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10352:1876180578925696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265410.714816:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.714889:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f1516c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265410.714972:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578925696 00000100:00100000:1.0:1789265410.714980:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578925696 00000100:00100000:1.0:1789265410.715037:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789265410.715047:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+19:10352:x1876180578925696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265410.715296:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+19:10352:x1876180578925696:12345-0@lo:502:llog_process_th.0 Request processed in 250us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265410.715304:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789265410.715685:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10352:1876180578925696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789265410.715716:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265410.715725:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265410.715727:0:10352:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789265410.715736:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1789265410.716404:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789265410.716430:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789265410.716444:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a46 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.716457:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a46 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265410.716469:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789265410.716471:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93774e5c3000 from 48 10000000:01000000:0.0:1789265410.716474:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265410.716525:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.716535:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.716547:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265410.716573:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578925824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.716630:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.716816:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377455379c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265410.720765:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578925824 00000100:00100000:1.0:1789265410.720816:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578925824 00000100:00100000:1.0:1789265410.721337:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789265410.721353:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+19:6516:x1876180578925824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265410.721378:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265410.721405:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bc400/0xbbfdc9019c1d3a54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3a4d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.721445:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bc400/0xbbfdc9019c1d3a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a4d expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.721460:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bc400/0xbbfdc9019c1d3a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a4d expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.721471:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc400, rc 0) 00000100:00100000:1.0:1789265410.721762:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578925824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 414us (5130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265410.721770:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789265410.725839:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578925824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265410.726181:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.726197:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265410.726360:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578925952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.726444:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265410.726561:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265410.729488:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578925952 00000100:00100000:2.0:1789265410.729520:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578925952 00000100:00100000:2.0:1789265410.729597:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789265410.729609:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578925952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.730538:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578925952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 926us (4089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265410.730549:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789265410.733643:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578925952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.734768:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578926080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.735107:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.735471:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265410.735595:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578926080 00000100:00100000:1.0:1789265410.735607:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578926080 00000100:00100000:1.0:1789265410.735842:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789265410.735878:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578926080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265410.736077:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578926080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265410.736087:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789265410.736313:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578926080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.738460:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10353:1876180578926208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265410.738785:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265410.738840:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.739273:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578926208 00000100:00100000:0.0:1789265410.739283:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578926208 00000100:00100000:0.0:1789265410.739687:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789265410.739701:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+20:10353:x1876180578926208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265410.739920:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+20:10353:x1876180578926208:12345-0@lo:502:llog_process_th.0 Request processed in 221us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.739929:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789265410.740665:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10353:1876180578926208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265410.740760:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10353:1876180578926336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265410.740819:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265410.741829:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.741929:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578926336 00000100:00100000:0.0:1789265410.741951:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578926336 00000100:00100000:0.0:1789265410.742011:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789265410.742022:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+20:10353:x1876180578926336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265410.742529:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+20:10353:x1876180578926336:12345-0@lo:502:llog_process_th.0 Request processed in 507us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.742539:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789265410.742884:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10353:1876180578926336:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789265410.742929:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789265410.743411:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789265410.743436:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265410.743451:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.743465:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265410.743477:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789265410.743480:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1789265410.743484:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789265410.743588:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.743597:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.743627:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265410.743655:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578926464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.743793:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.743843:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.744038:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578926464 00000100:00100000:3.0:1789265410.744045:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578926464 00000100:00100000:3.0:1789265410.744307:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789265410.744329:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578926464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265410.744346:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265410.744364:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937643218e00/0xbbfdc9019c1d3a62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3a5b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.744393:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643218e00/0xbbfdc9019c1d3a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a5b expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.744405:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937643218e00/0xbbfdc9019c1d3a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a5b expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.744416:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643218e00, rc 0) 00000100:00100000:3.0:1789265410.744483:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578926464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.744490:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789265410.744773:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578926464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265410.744791:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.744802:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265410.744903:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578926592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.744936:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.745436:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265410.745488:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578926592 00000100:00100000:1.0:1789265410.745496:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578926592 00000100:00100000:1.0:1789265410.745603:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789265410.745613:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578926592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265410.746045:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578926592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 433us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265410.746054:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789265410.746269:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578926592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.746391:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578926720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.746444:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.746485:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265410.746598:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578926720 00000100:00100000:2.0:1789265410.746603:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578926720 00000100:00100000:2.0:1789265410.746792:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789265410.746803:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578926720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.746957:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578926720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265410.746966:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789265410.747052:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578926720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265410.749300:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10354:1876180578926848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265410.749493:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265410.749632:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.749735:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578926848 00000100:00100000:3.0:1789265410.749745:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578926848 00000100:00100000:3.0:1789265410.749849:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789265410.749886:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:10354:x1876180578926848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265410.750369:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:10354:x1876180578926848:12345-0@lo:502:llog_process_th.0 Request processed in 510us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.750379:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789265410.751921:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10354:1876180578926848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265410.752439:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265410.752457:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265410.752460:0:10354:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789265410.752468:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789265410.752647:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10354:1876180578926976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265410.752800:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265410.752855:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265410.753294:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578926976 00000100:00100000:2.0:1789265410.753305:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578926976 00000100:00100000:2.0:1789265410.753367:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789265410.753377:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:10354:x1876180578926976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265410.753810:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:10354:x1876180578926976:12345-0@lo:502:llog_process_th.0 Request processed in 433us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265410.753818:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789265410.754927:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10354:1876180578926976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265410.755386:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265410.755399:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265410.755402:0:10354:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789265410.755408:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1789265410.755816:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1789265410.755844:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789265410.757603:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.757629:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265410.757645:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789265410.757648:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff937779e62800 from 48 10000000:01000000:2.0:1789265410.757652:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265410.758275:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.758287:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.758323:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265410.758360:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578927104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.758469:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265410.758764:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578927104 00000100:00100000:3.0:1789265410.758773:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578927104 00000100:00100000:3.0:1789265410.758836:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789265410.758847:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578927104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265410.758891:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265410.758909:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937643218600/0xbbfdc9019c1d3a70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3a69 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.758937:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643218600/0xbbfdc9019c1d3a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a69 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.759236:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937643218600/0xbbfdc9019c1d3a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a69 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.759255:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643218600, rc 0) 00000100:00100000:2.0:1789265410.760388:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f151480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.767556:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578927104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 8695us (9072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.767573:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789265410.768406:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578927104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265410.768442:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265410.768459:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265410.768747:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578927232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.768806:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.768909:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f151480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265410.769973:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578927232 00000100:00100000:1.0:1789265410.769988:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578927232 00000100:00100000:1.0:1789265410.770069:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789265410.770082:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578927232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265410.771426:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578927232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1338us (2610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265410.771440:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789265410.772917:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578927232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.773278:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578927360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.773380:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.773440:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377455373c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265410.773882:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578927360 00000100:00100000:1.0:1789265410.773893:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578927360 00000100:00100000:0.0:1789265410.774492:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789265410.774659:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578927360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.775363:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578927360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 857us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.775372:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789265410.783213:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578927360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265410.784424:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10355:1876180578927488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265410.784542:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.784641:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f1510c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.789338:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578927488 00000100:00100000:0.0:1789265410.789362:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578927488 00000100:00100000:0.0:1789265410.789487:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789265410.789598:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+22:10355:x1876180578927488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265410.790076:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+22:10355:x1876180578927488:12345-0@lo:502:llog_process_th.0 Request processed in 576us (5531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.790087:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789265410.790407:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10355:1876180578927488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265410.792656:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10355:1876180578927616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265410.793391:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265410.793470:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f1510c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265410.793630:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578927616 00000100:00100000:1.0:1789265410.793641:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578927616 00000100:00100000:1.0:1789265410.793783:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789265410.793795:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:10355:x1876180578927616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265410.794254:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:10355:x1876180578927616:12345-0@lo:502:llog_process_th.0 Request processed in 450us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265410.794263:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789265410.794629:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10355:1876180578927616:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789265410.795055:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789265410.795463:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789265410.795491:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265410.795572:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.795587:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265410.795600:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789265410.795603:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1789265410.795607:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265410.795655:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.795664:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.796226:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265410.796269:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578927744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265410.796367:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265410.796471:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0000 going to sleep for 11 seconds 00000100:00100000:0.0:1789265410.797460:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578927744 00000100:00100000:0.0:1789265410.797474:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578927744 00000100:00100000:3.0:1789265410.798384:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789265410.799254:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578927744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265410.799283:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265410.799312:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3a7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3a77 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.799354:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a77 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.799369:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a77 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265410.799380:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc800, rc 0) 00000100:00100000:1.0:1789265410.799639:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578927744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1240us (3271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265410.799647:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789265410.799779:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578927744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265410.799805:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265410.799816:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265410.800313:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578927872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.800369:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.800443:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265410.800619:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578927872 00000100:00100000:1.0:1789265410.800628:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578927872 00000100:00100000:1.0:1789265410.800746:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789265410.800757:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578927872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265410.801225:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578927872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 468us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265410.801234:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789265410.801438:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578927872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.801490:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578928000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.801658:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.801786:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265410.801831:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578928000 00000100:00100000:1.0:1789265410.801837:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578928000 00000100:00100000:1.0:1789265410.802209:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789265410.802220:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578928000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265410.802391:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578928000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265410.802399:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789265410.802478:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578928000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265410.803172:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10356:1876180578928128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265410.803223:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.803518:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.803733:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578928128 00000100:00100000:3.0:1789265410.803746:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578928128 00000100:00100000:3.0:1789265410.803775:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789265410.803781:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:10356:x1876180578928128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265410.803899:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:10356:x1876180578928128:12345-0@lo:502:llog_process_th.0 Request processed in 118us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.803905:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789265410.804038:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10356:1876180578928128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265410.804075:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265410.804084:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265410.804086:0:10356:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789265410.804090:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789265410.804118:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10356:1876180578928256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265410.804145:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265410.804166:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.804256:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578928256 00000100:00100000:3.0:1789265410.804261:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578928256 00000100:00100000:3.0:1789265410.804280:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789265410.804286:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:10356:x1876180578928256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265410.804353:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:10356:x1876180578928256:12345-0@lo:502:llog_process_th.0 Request processed in 67us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.804359:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789265410.804458:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642418000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10356:1876180578928256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265410.804473:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265410.804477:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265410.804479:0:10356:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789265410.804483:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789265410.804666:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1789265410.804693:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789265410.804707:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.804720:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265410.804733:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789265410.804736:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93775f68cd28 from 1 10000000:01000000:3.0:1789265410.804740:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789265410.804768:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643218c00/0xbbfdc9019c1d3a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.804774:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937643218c00/0xbbfdc9019c1d3a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.804789:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937643218c00/0xbbfdc9019c1d3a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265410.804800:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578928384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.804822:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265410.804839:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578928384 00000100:00100000:3.0:1789265410.804841:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578928384 00000100:00100000:3.0:1789265410.804853:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789265410.804857:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578928384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265410.804886:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265410.804897:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937643219800/0xbbfdc9019c1d3a8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3a85 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.804916:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643219800/0xbbfdc9019c1d3a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a85 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.804924:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937643219800/0xbbfdc9019c1d3a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a85 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.804931:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219800, rc 0) 00000100:00100000:3.0:1789265410.804957:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578928384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.804962:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789265410.804978:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.804986:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578928384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265410.804995:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937643218c00/0xbbfdc9019c1d3a85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a8c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.805013:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937643218c00/0xbbfdc9019c1d3a85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a8c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265410.805075:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578928512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.805093:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265410.805107:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578928512 00000100:00100000:3.0:1789265410.805326:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578928512 00000100:00100000:3.0:1789265410.805349:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789265410.805355:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578928512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265410.805423:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578928512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (328us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265410.805430:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789265410.805452:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265410.805464:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578928512:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789265410.805486:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789265410.805492:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643218c00/0xbbfdc9019c1d3a85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a8c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265410.805499:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937643218c00/0xbbfdc9019c1d3a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a8c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265410.816445:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265410.816514:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265410.816546:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265410.816590:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265410.816645:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265410.816691:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556846208 00000100:00100000:0.0:1789265410.816705:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556846208 00000100:00100000:0.0:1789265410.816782:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556846336 00000100:00100000:0.0:1789265410.816786:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556846336 00000100:00100000:0.0:1789265410.816820:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:0.0:1789265410.816831:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2397:x1876180556846208:12345-192.168.202.42@tcp:400: 00000100:00100000:0.0:1789265410.816973:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2397:x1876180556846208:12345-192.168.202.42@tcp:400: Request processed in 142us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.816981:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:0.0:1789265410.817002:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:0.0:1789265410.817009:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556846336:12345-192.168.202.42@tcp:400: 00000100:00100000:0.0:1789265410.817036:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556846336:12345-192.168.202.42@tcp:400: Request processed in 26us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.817042:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:0.0:1789265410.817065:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556846592 00000100:00100000:0.0:1789265410.817068:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556846592 00000100:00100000:0.0:1789265410.817098:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556846464 00000100:00100000:0.0:1789265410.817102:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556846464 00000100:00100000:0.0:1789265410.817384:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:0.0:1789265410.817393:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556846592:12345-192.168.202.42@tcp:400: 00000100:00100000:0.0:1789265410.817427:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556846592:12345-192.168.202.42@tcp:400: Request processed in 35us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.817434:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:0.0:1789265410.817447:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:0.0:1789265410.817454:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556846464:12345-192.168.202.42@tcp:400: 00000100:00100000:0.0:1789265410.817559:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556846464:12345-192.168.202.42@tcp:400: Request processed in 44us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265410.817569:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:3.0:1789265410.818053:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556846080 00000100:00100000:3.0:1789265410.818070:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556846080 00000100:00100000:3.0:1789265410.818253:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 245 00000100:00100000:3.0:1789265410.818264:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+8:2398:x1876180556846080:12345-192.168.202.42@tcp:400: 00000100:00100000:3.0:1789265410.818313:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+8:2398:x1876180556846080:12345-192.168.202.42@tcp:400: Request processed in 52us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265410.818320:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 245 00000100:00080000:1.0:1789265410.819547:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265410.819559:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265410.819564:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265410.819567:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265411.571429:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578928640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265411.571550:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265411.571825:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578928640 00000100:00100000:3.0:1789265411.571836:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578928640 00000100:00100000:3.0:1789265411.571925:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789265411.571937:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578928640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265411.571983:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789265411.572200:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578928768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265411.572245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265411.572283:0:6525:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789265411.572294:0:6525:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1789265411.572441:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578928768 00000100:00100000:0.0:1789265411.572446:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578928768 00000100:00100000:0.0:1789265411.572572:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789265411.572580:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578928768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265411.572602:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265411.572641:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578928768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265411.572649:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789265411.572701:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578928768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265411.574922:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578928640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2973us (3358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265411.574939:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789265411.575404:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578928640:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789265411.636300:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265412.083259:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578928896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265412.083367:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265412.083463:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265412.083470:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578929024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265412.083473:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578928896 00000100:00100000:0.0:1789265412.083484:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578928896 00000100:00100000:1.0:1789265412.083495:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789265412.083554:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265412.083564:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578929024 00000100:00100000:0.0:1789265412.083567:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578929024 00000100:00080000:1.0:1789265412.083589:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265412.083607:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265412.083618:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578928896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265412.083656:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265412.083718:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578928896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265412.083727:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265412.083764:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265412.083770:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578929024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265412.083779:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1789265412.083782:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376434d6a00 x1876180578928896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265412.083802:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578929024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265412.083805:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578928896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265412.083808:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789265412.083844:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36ea00 x1876180578929024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265412.083856:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578929024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265412.606372:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265412.606604:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556846720 00000100:00100000:3.0:1789265412.606619:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556846720 00000100:00100000:3.0:1789265412.606702:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 246 00000100:00100000:3.0:1789265412.606715:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+8:6173:x1876180556846720:12345-192.168.202.42@tcp:101: 00010000:00010000:3.0:1789265412.606739:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265412.606763:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937643218000/0xbbfdc9019c1d3a93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919056 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.606800:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643218000/0xbbfdc9019c1d3a93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919056 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.606816:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937643218000/0xbbfdc9019c1d3a93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919056 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.606827:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643218000, rc 0) 00000100:00100000:3.0:1789265412.607200:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+9:6173:x1876180556846720:12345-192.168.202.42@tcp:101: Request processed in 486us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265412.607238:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 246 00000100:00100000:1.0:1789265412.624114:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265412.624424:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556846848 00000100:00100000:2.0:1789265412.624438:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556846848 00000100:00100000:2.0:1789265412.624517:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 247 00000100:00100000:2.0:1789265412.624530:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+9:6173:x1876180556846848:12345-192.168.202.42@tcp:501: 00000100:00100000:2.0:1789265412.624736:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+9:6173:x1876180556846848:12345-192.168.202.42@tcp:501: Request processed in 207us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265412.624745:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 247 00000100:00100000:0.0:1789265412.629282:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265412.629604:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556846976 00000100:00100000:1.0:1789265412.629618:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556846976 00000100:00100000:1.0:1789265412.629853:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 248 00000100:00100000:1.0:1789265412.629902:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+9:6173:x1876180556846976:12345-192.168.202.42@tcp:503: 00000100:00100000:1.0:1789265412.630135:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+9:6173:x1876180556846976:12345-192.168.202.42@tcp:503: Request processed in 237us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265412.630144:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 248 00000100:00100000:0.0:1789265412.636955:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265412.638563:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556847104 00000100:00100000:3.0:1789265412.638582:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556847104 00000100:00100000:3.0:1789265412.638678:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 249 00000100:00100000:3.0:1789265412.639779:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+9:6663:x1876180556847104:12345-192.168.202.42@tcp:502: 00000100:00100000:3.0:1789265412.640027:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+9:6663:x1876180556847104:12345-192.168.202.42@tcp:502: Request processed in 265us (3087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265412.647599:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 249 00000100:00100000:1.0:1789265412.648206:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265412.653107:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556847232 00000100:00100000:2.0:1789265412.653133:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556847232 00000100:00100000:2.0:1789265412.653246:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 250 00000100:00100000:2.0:1789265412.653260:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+9:6663:x1876180556847232:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265412.653642:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+9:6663:x1876180556847232:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 383us (5439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265412.653651:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 250 00000100:00100000:0.0:1789265412.658604:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265412.658698:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556847360 00000100:00100000:3.0:1789265412.658710:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556847360 00000100:00100000:3.0:1789265412.658784:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 251 00000100:00100000:3.0:1789265412.658796:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775011b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+9:6173:x1876180556847360:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265412.658822:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265412.658854:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937643219000/0xbbfdc9019c1d3a9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91905d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.658949:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643219000/0xbbfdc9019c1d3a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91905d expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.658963:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937643219000/0xbbfdc9019c1d3a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91905d expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265412.658975:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219000, rc 0) 00000100:00100000:3.0:1789265412.659046:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775011b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:6173:x1876180556847360:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 251us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265412.659054:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 251 00010000:00010000:0.0:1789265412.659621:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265412.661621:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265412.667563:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556847488 00000100:00100000:1.0:1789265412.667587:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556847488 00000100:00100000:3.0:1789265412.668643:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 252 00000100:00100000:3.0:1789265412.668663:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:6173:x1876180556847488:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265412.671657:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:6173:x1876180556847488:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 2986us (10030us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265412.671676:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 252 00010000:00010000:2.0:1789265413.688835:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789265414.123295:0:10394:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb53758e0 20000000:00000080:1.0:1789265414.123313:0:10394:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93764369b000 uarg=0000000000000000 20000000:01000000:1.0:1789265414.123356:0:10394:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789265414.123361:0:10394:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789265414.123366:0:10394:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789265414.124222:0:10395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789265414.124388:0:10394:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789265414.130630:0:10394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789265414.130668:0:10394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789265414.130684:0:10394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789265414.130704:0:10394:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789265414.130725:0:10394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.130746:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93774167fc00/0xbbfdc9019c1d373d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3736 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.130821:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377413fcc00/0xbbfdc9019c1d374b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3744 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.130829:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d379f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3798 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.130836:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d38c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d38be expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.131166:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9376435fde00/0xbbfdc9019c1d39dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91901e expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.131174:0:10394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.131234:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9376435fde00/0xbbfdc9019c1d39dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91901e expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.131250:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9376435fde00/0xbbfdc9019c1d39dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91901e expref: 9 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265414.131266:0:10394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1876180578929152:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265414.131485:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d38c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d38be expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.131493:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d38c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d38be expref: 23 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265414.131504:0:10394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1876180578929280:0@lo:104: 00000100:00100000:1.0:1789265414.131543:0:10394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265414.131601:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d379f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3798 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.131609:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d379f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3798 expref: 23 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265414.131619:0:10394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643587b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1876180578929408:0@lo:104: 00000100:00100000:1.0:1789265414.131654:0:10394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265414.131682:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377413fcc00/0xbbfdc9019c1d374b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3744 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.131690:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377413fcc00/0xbbfdc9019c1d374b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3744 expref: 23 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265414.131698:0:10394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643587100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1876180578929536:0@lo:104: 00010000:00010000:1.0:1789265414.131721:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93774167fc00/0xbbfdc9019c1d373d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3736 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.131728:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93774167fc00/0xbbfdc9019c1d373d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3736 expref: 23 pid: 6514 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265414.131735:0:10394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643585880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1876180578929664:0@lo:104: 00000100:00100000:1.0:1789265414.131763:0:10394:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265414.132036:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789265414.132058:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265414.132070:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265414.132078:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578929280 00000100:00100000:2.0:1789265414.132085:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578929280 00000100:00100000:2.0:1789265414.132125:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578929408 00000100:00100000:2.0:1789265414.132128:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578929408 00000100:00100000:2.0:1789265414.132137:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578929536 00000100:00100000:2.0:1789265414.132140:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578929536 00000100:00100000:2.0:1789265414.132148:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578929664 00000100:00100000:2.0:1789265414.132150:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578929664 00000100:00100000:2.0:1789265414.132164:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265414.132172:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+6:10394:x1876180578929280:12345-0@lo:104: 00010000:00010000:2.0:1789265414.132184:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d38c5 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132257:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265414.132263:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+6:10394:x1876180578929280:12345-0@lo:104: Request processed in 92us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265414.132270:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265414.132288:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789265414.132295:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764368c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+5:10394:x1876180578929408:12345-0@lo:104: 00010000:00010000:2.0:1789265414.132302:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d379f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132334:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265414.132339:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764368c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+5:10394:x1876180578929408:12345-0@lo:104: Request processed in 46us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265414.132345:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789265414.132388:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789265414.132395:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+4:10394:x1876180578929536:12345-0@lo:104: 00010000:00010000:2.0:1789265414.132403:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d374b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132446:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789265414.132451:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+4:10394:x1876180578929536:12345-0@lo:104: Request processed in 58us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265414.132458:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789265414.132469:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265414.132475:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:10394:x1876180578929664:12345-0@lo:104: 00010000:00010000:2.0:1789265414.132482:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937740031c00/0xbbfdc9019c1d3736 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d373d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132507:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789265414.132511:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:10394:x1876180578929664:12345-0@lo:104: Request processed in 38us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265414.132517:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1789265414.132533:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789265414.132539:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d38c5 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132546:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fda00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265414.132549:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d38c5 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132557:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d38c5 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265414.132573:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d38c5 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265414.132579:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265414.132607:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d38c5 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132613:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265414.132632:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d38c5 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132639:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377413fda00/0xbbfdc9019c1d38be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d38c5 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132652:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789265414.132655:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d379f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132659:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fd400 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265414.132662:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d379f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132669:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d379f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265414.132675:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d379f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265414.132679:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265414.132693:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d379f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132699:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265414.132703:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d379f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132709:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377413fd400/0xbbfdc9019c1d3798 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d379f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132716:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265414.132718:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d374b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132723:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fdc00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265414.132726:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d374b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132732:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d374b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265414.132737:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d374b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265414.132741:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265414.132749:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d374b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.132984:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265414.133001:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d374b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.133016:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377413fdc00/0xbbfdc9019c1d3744 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d374b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.133025:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265414.133028:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937740031c00/0xbbfdc9019c1d3736 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d373d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.133032:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031c00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265414.133035:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937740031c00/0xbbfdc9019c1d3736 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d373d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.133041:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937740031c00/0xbbfdc9019c1d3736 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d373d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265414.133046:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937740031c00/0xbbfdc9019c1d3736 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d373d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265414.133051:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265414.133063:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937740031c00/0xbbfdc9019c1d3736 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d373d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.133068:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265414.133073:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937740031c00/0xbbfdc9019c1d3736 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d373d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.133079:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937740031c00/0xbbfdc9019c1d3736 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d373d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.133089:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265414.133095:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265414.133097:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265414.133112:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578929792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265414.133144:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265414.133177:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265414.133183:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578929920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265414.133281:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265414.133312:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578930048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265414.133337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265414.133354:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265414.133359:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578930176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265414.133382:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265414.133406:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578929792 00000100:00100000:2.0:1789265414.133412:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578929792 00010000:00010000:2.0:1789265414.133553:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d38c5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d38be expref: 24 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265414.133570:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578929920 00000100:00100000:2.0:1789265414.133573:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578929920 00010000:00010000:2.0:1789265414.133583:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d379f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3798 expref: 25 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265414.133593:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578930048 00000100:00100000:2.0:1789265414.133595:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578930048 00010000:00010000:2.0:1789265414.133605:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377413fcc00/0xbbfdc9019c1d374b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3744 expref: 26 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265414.133615:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578930176 00000100:00100000:2.0:1789265414.133618:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578930176 00010000:00010000:2.0:1789265414.133627:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93774167fc00/0xbbfdc9019c1d373d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3736 expref: 27 pid: 6514 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265414.133649:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789265414.133656:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+27:3643:x1876180578929792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265414.133667:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265414.133673:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d38c5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d38be expref: 27 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.133683:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d38c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d38be expref: 27 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.133701:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265414.133731:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+27:3643:x1876180578929792:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265414.133738:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1789265414.133905:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377413fd800/0xbbfdc9019c1d38c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d38be expref: 26 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265414.133917:0:10394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1876180578929280:0@lo:104: 00000100:00100000:1.0:1789265414.133928:0:10394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643587b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1876180578929408:0@lo:104: 00000100:00100000:1.0:1789265414.133935:0:10394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643587100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1876180578929536:0@lo:104: 00000100:00100000:1.0:1789265414.133942:0:10394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643585880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1876180578929664:0@lo:104: 00000100:00100000:2.0:1789265414.134001:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265414.134010:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+25:3643:x1876180578929920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265414.134017:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265414.134022:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d379f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3798 expref: 25 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.134030:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d379f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3798 expref: 25 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.134040:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937740030e00/0xbbfdc9019c1d379f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3798 expref: 25 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.134050:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265414.134075:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3643:x1876180578929920:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265414.134088:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265414.134100:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265414.134107:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+23:3645:x1876180578930048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265414.134114:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265414.134119:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377413fcc00/0xbbfdc9019c1d374b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3744 expref: 23 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.134126:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377413fcc00/0xbbfdc9019c1d374b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3744 expref: 23 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.134135:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377413fcc00/0xbbfdc9019c1d374b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3744 expref: 23 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.134146:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265414.134566:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+22:3645:x1876180578930048:12345-0@lo:103:ldlm_bl.0 Request processed in 459us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265414.134574:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265414.134588:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265414.134597:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f67d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+21:3645:x1876180578930176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265414.134605:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265414.134610:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93774167fc00/0xbbfdc9019c1d373d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3736 expref: 21 pid: 6514 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.134620:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93774167fc00/0xbbfdc9019c1d373d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3736 expref: 21 pid: 6514 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.134631:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93774167fc00/0xbbfdc9019c1d373d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3736 expref: 21 pid: 6514 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.134652:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265414.134675:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f67d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+20:3645:x1876180578930176:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265414.134682:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265414.134740:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578929920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265414.134750:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578929792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265414.135056:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265414.136123:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578930048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265414.136151:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578930176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265414.140465:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265414.140576:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556847616 00000100:00100000:2.0:1789265414.140586:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556847616 00010000:00010000:2.0:1789265414.140628:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9376435fde00/0xbbfdc9019c1d39dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91901e expref: 10 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265414.140661:0:10394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1876180578929152:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265414.140676:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:2.0:1789265414.140685:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63f6cd89-abac-4801-8de9-f59ae281263f+10:2399:x1876180556847616:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265414.140700:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265414.140701:0:10394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.140706:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9376435fde00/0xbbfdc9019c1d39dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91901e expref: 10 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.140716:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9376435fde00/0xbbfdc9019c1d39dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91901e expref: 10 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.140733:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9376435fde00/0xbbfdc9019c1d39dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91901e expref: 10 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.140900:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.140909:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.140930:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.140939:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.140946:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.140952:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.140959:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd800 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:2.0:1789265414.140962:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.140970:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.140990:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265414.140999:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265414.141065:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63f6cd89-abac-4801-8de9-f59ae281263f+9:2399:x1876180556847616:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 380us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265414.141073:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 39 00010000:00010000:1.0:1789265414.141250:0:10394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.141259:0:10394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.141265:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3aa1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265414.711597:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265415.155855:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643587100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578930432:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156022:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.156091:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578930944:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156113:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.156136:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578931456:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156157:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.156185:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1789265415.156191:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578930304:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156232:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.156255:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578930816:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156278:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.156298:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578931328:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156321:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.156341:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578931840:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156378:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.156417:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578930560:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156443:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.156469:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578931072:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156492:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.156509:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180578931584:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156548:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.156562:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789265415.156568:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578930688:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156588:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.156599:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578931200:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156619:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.156638:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578931712:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156656:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265415.156670:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578930816 00000100:00100000:0.0:1789265415.156678:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578930816 00000100:00100000:1.0:1789265415.156687:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578930432 00000100:00100000:1.0:1789265415.156690:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578930432 00000100:00100000:1.0:1789265415.156717:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578930944 00000100:00100000:0.0:1789265415.156719:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578930560 00000100:00100000:1.0:1789265415.156720:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578930944 00000100:00100000:0.0:1789265415.156721:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578930560 00000100:00100000:0.0:1789265415.156738:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789265415.156740:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578931456 00000100:00100000:1.0:1789265415.156742:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578931456 00000100:00100000:0.0:1789265415.156748:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578930816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156752:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578931072 00000100:00100000:1.0:1789265415.156754:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578931072 00000100:00100000:1.0:1789265415.156764:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578931584 00000100:00100000:1.0:1789265415.156766:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578931584 00000100:00100000:1.0:1789265415.156774:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578930688 00000100:00100000:1.0:1789265415.156776:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578930688 00000100:00100000:1.0:1789265415.156787:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789265415.156792:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578930432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265415.156809:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578930816:12345-0@lo:400:kworker.0 Request processed in 63us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265415.156817:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789265415.156820:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578930432:12345-0@lo:400:kworker.0 Request processed in 29us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.156831:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789265415.156834:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789265415.156840:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578930560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156844:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265415.156849:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578930944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265415.156892:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578930560:12345-0@lo:400:kworker.0 Request processed in 51us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.156898:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578930944:12345-0@lo:400:kworker.0 Request processed in 50us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.156904:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789265415.156906:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789265415.156917:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265415.156924:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578931456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.156959:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578931456:12345-0@lo:400:kworker.0 Request processed in 35us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.156964:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265415.156976:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265415.156983:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578931072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.157008:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578931072:12345-0@lo:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.157014:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265415.157024:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789265415.157029:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180578931584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.157054:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180578931584:12345-0@lo:400:kworker.0 Request processed in 25us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.157060:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789265415.157070:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789265415.157075:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578930688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.157112:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578930688:12345-0@lo:400:kworker.0 Request processed in 36us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.157122:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789265415.157151:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578930304 00000100:00100000:1.0:1789265415.157154:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578930304 00000100:00100000:1.0:1789265415.157183:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789265415.157190:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+20:3644:x1876180578930304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.157237:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+20:3644:x1876180578930304:12345-0@lo:400:kworker.0 Request processed in 48us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.157244:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789265415.157279:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578931328 00000100:00100000:1.0:1789265415.157283:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578931328 00000100:00100000:1.0:1789265415.157307:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578931840 00000100:00100000:1.0:1789265415.157310:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578931840 00000100:00100000:1.0:1789265415.157325:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578931200 00000100:00100000:1.0:1789265415.157328:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578931200 00000100:00100000:1.0:1789265415.157342:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578931712 00000100:00100000:1.0:1789265415.157345:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578931712 00000100:00100000:1.0:1789265415.157360:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789265415.157367:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578931328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.157397:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578931328:12345-0@lo:400:kworker.0 Request processed in 32us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.157404:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789265415.157415:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789265415.157420:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578931840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.157449:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578931840:12345-0@lo:400:kworker.0 Request processed in 29us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.157454:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789265415.157464:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789265415.157477:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578931200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.157506:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578931200:12345-0@lo:400:kworker.0 Request processed in 31us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.157513:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789265415.157524:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265415.157530:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578931712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.157558:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578931712:12345-0@lo:400:kworker.0 Request processed in 28us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.157565:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789265415.157600:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265415.157605:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265415.157609:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265415.157611:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265415.157648:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578930688:0@lo:400:kworker.0 00010000:00080000:1.0:1789265415.157662:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643585500 x1876180578931200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265415.157672:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578931200:0@lo:400:kworker.0 00010000:00080000:1.0:1789265415.157684:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643586a00 x1876180578931712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265415.157693:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578931712:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.157707:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578930560:0@lo:400:kworker.0 00010000:00080000:1.0:1789265415.157719:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643584a80 x1876180578931072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265415.157727:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578931072:0@lo:400:kworker.0 00010000:00080000:1.0:1789265415.157747:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643585f80 x1876180578931584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265415.157755:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180578931584:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.157792:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578930304:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.157803:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578930816:0@lo:400:kworker.0 00010000:00080000:1.0:1789265415.157812:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643585180 x1876180578931328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265415.157820:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578931328:0@lo:400:kworker.0 00010000:00080000:1.0:1789265415.157829:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643584380 x1876180578931840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265415.157835:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578931840:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.157845:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643587100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578930432:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.157856:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578930944:0@lo:400:kworker.0 00000100:00100000:1.0:1789265415.157893:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578931456:0@lo:400:kworker.0 00000100:00100000:3.0:1789265415.667779:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578931968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265415.667876:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.667945:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578931968 00000100:00100000:1.0:1789265415.667955:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578931968 00000100:00100000:1.0:1789265415.668012:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265415.668024:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578931968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265415.668058:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265415.668107:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578931968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.668133:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265415.668250:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265415.668262:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578932096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265415.668291:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265415.668330:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578932096 00000100:00100000:2.0:1789265415.668334:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578932096 00000100:00100000:2.0:1789265415.668353:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265415.668358:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578932096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265415.668368:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265415.668407:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578932096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265415.668413:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789265415.668885:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435efb80 x1876180578931968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265415.668910:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578931968:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789265415.668919:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36d180 x1876180578932096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265415.668931:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578932096:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789265415.734608:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265415.795115:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265415.795124:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff937641a6a800 from 4 10000000:01000000:2.0:1789265415.795130:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265415.795179:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265415.795291:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265415.795318:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265415.795349:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578932224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265415.795426:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265415.795499:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f151b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265415.795813:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578932224 00000100:00100000:0.0:1789265415.795822:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578932224 00000100:00100000:0.0:1789265415.795927:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789265415.795938:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578932224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265415.795953:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265415.795968:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937642393000/0xbbfdc9019c1d3aaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3aa8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265415.795994:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642393000/0xbbfdc9019c1d3aaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3aa8 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265415.796006:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937642393000/0xbbfdc9019c1d3aaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3aa8 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265415.796016:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393000, rc 0) 00000100:00100000:0.0:1789265415.796063:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578932224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265415.796071:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789265415.796454:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578932224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265415.796471:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3aaf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265415.796480:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3aaf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265415.798081:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578932352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265415.798149:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265415.800234:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f151b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265415.803303:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578932352 00000100:00100000:1.0:1789265415.803321:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578932352 00000100:00100000:1.0:1789265415.803386:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789265415.803398:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775011b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578932352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265415.803607:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775011b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578932352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (5458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.803616:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789265415.804441:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578932352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.804502:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578932480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.804577:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265415.804626:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377454f0240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265415.804678:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578932480 00000100:00100000:2.0:1789265415.804684:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578932480 00000100:00100000:2.0:1789265415.804731:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789265415.804739:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578932480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265415.804840:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578932480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265415.804848:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789265415.808837:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578932480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.809100:0:10463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10463:1876180578932608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265415.809176:0:10463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265415.809225:0:10463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377454f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265415.810140:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578932608 00000100:00100000:2.0:1789265415.810150:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578932608 00000100:00100000:2.0:1789265415.810215:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789265415.810227:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:10463:x1876180578932608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265415.810373:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:10463:x1876180578932608:12345-0@lo:502:llog_process_th.0 Request processed in 148us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265415.810381:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789265415.810983:0:10463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10463:1876180578932608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265415.811018:0:10463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265415.811028:0:10463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265415.811031:0:10463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789265415.811038:0:10463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff937641a6a800 00000020:00000080:3.0:1789265415.811041:0:10463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789265415.811137:0:10463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10463:1876180578932736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265415.811209:0:10463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265415.811248:0:10463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377454f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265415.816237:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578932736 00000100:00100000:2.0:1789265415.816254:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578932736 00000100:00100000:2.0:1789265415.816322:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789265415.816334:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:10463:x1876180578932736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265415.816529:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:10463:x1876180578932736:12345-0@lo:502:llog_process_th.0 Request processed in 197us (5318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265415.816538:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789265415.817137:0:10463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10463:1876180578932736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265415.817179:0:10463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265415.817207:0:10463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265415.817210:0:10463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789265415.817217:0:10463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789265415.819803:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789265415.819906:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265415.819919:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3aaf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265415.819933:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3aaf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265415.819944:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265415.819947:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93777aaec000 from 4 10000000:01000000:2.0:1789265415.819949:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265415.819987:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265415.819996:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265415.820006:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265415.820034:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578932864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265415.820105:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265415.820150:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f1519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265415.820174:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578932864 00000100:00100000:2.0:1789265415.820181:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578932864 00000100:00100000:2.0:1789265415.820238:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789265415.820246:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578932864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265415.820259:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265415.820271:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d3abd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3ab6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265415.820304:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d3abd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3ab6 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265415.820313:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d3abd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3ab6 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265415.820321:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd200, rc 0) 00000100:00100000:2.0:1789265415.820356:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578932864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265415.820362:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789265415.820405:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578932864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265415.820417:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3abd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265415.820425:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3abd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265415.820472:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578932992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265415.820508:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265415.820524:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f1519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265415.823227:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265415.831014:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578932992 00000100:00100000:1.0:1789265415.831033:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578932992 00000100:00100000:1.0:1789265415.831094:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789265415.831104:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578932992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265415.831287:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578932992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (10777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.831294:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789265415.831321:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556847744 00000100:00100000:1.0:1789265415.831325:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556847744 00000100:00100000:1.0:1789265415.831342:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 261 00000100:00100000:1.0:1789265415.831348:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+9:6173:x1876180556847744:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265415.831356:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265415.831372:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d3ac4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919064 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265415.831408:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d3ac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919064 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265415.831419:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d3ac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919064 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265415.831429:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd400, rc 0) 00000100:00100000:1.0:1789265415.831476:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:6173:x1876180556847744:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 127us (8259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.831482:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 261 00000100:00100000:1.0:1789265415.832056:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578932992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265415.832110:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578933120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265415.832163:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.832189:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f390000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265415.832228:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578933120 00000100:00100000:3.0:1789265415.832232:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578933120 00000100:00100000:3.0:1789265415.832258:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789265415.832265:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578933120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.832348:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578933120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265415.832355:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789265415.836308:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265415.836686:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578933120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.836891:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556847872 00000100:00100000:1.0:1789265415.837166:0:10467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10467:1876180578933248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265415.837641:0:10467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.837688:0:10467:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f390780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265415.837747:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556847872 00000100:00100000:3.0:1789265415.837807:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578933248 00000100:00100000:3.0:1789265415.837810:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578933248 00000100:00100000:3.0:1789265415.837828:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 263 00000100:00100000:3.0:1789265415.837837:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:6173:x1876180556847872:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265415.838005:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789265415.838276:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+22:10467:x1876180578933248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265415.838373:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+22:10467:x1876180578933248:12345-0@lo:502:llog_process_th.0 Request processed in 360us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.838381:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789265415.838440:0:10467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10467:1876180578933248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265415.838468:0:10467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265415.838477:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265415.838479:0:10467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789265415.838485:0:10467:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93777aaec000 00000100:00100000:3.0:1789265415.839135:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:6173:x1876180556847872:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 1294us (2833us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265415.839144:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 263 00000020:00000080:1.0:1789265415.841155:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789265415.846372:0:10467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10467:1876180578933376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265415.846463:0:10467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.846516:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578933376 00000100:00100000:1.0:1789265415.846522:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578933376 00000100:00100000:1.0:1789265415.846574:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789265415.846584:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+22:10467:x1876180578933376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265415.846699:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+22:10467:x1876180578933376:12345-0@lo:502:llog_process_th.0 Request processed in 116us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.846706:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789265415.846754:0:10467:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4e480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265415.846776:0:10467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10467:1876180578933376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265415.846803:0:10467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265415.846811:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265415.846813:0:10467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789265415.846817:0:10467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789265415.846901:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789265415.846919:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265415.846929:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3abd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265415.846940:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3abd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265415.846962:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265415.846964:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93774e5c3000 from 4 10000000:01000000:1.0:1789265415.846967:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265415.846990:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265415.846998:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265415.847008:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265415.847022:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578933504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265415.847048:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.847062:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4e480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265415.847470:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265415.847493:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578933504 00000100:00100000:3.0:1789265415.847498:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578933504 00000100:00100000:3.0:1789265415.847519:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556848000 00000100:00100000:3.0:1789265415.847530:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556848000 00000100:00100000:3.0:1789265415.847547:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789265415.847554:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578933504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265415.847564:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265415.847576:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937643219c00/0xbbfdc9019c1d3ad2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3acb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265415.847599:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643219c00/0xbbfdc9019c1d3ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3acb expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265415.847608:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937643219c00/0xbbfdc9019c1d3ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3acb expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265415.847615:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219c00, rc 0) 00000100:00100000:3.0:1789265415.847648:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578933504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265415.847654:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789265415.847674:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 267 00000100:00100000:3.0:1789265415.847681:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+10:6173:x1876180556848000:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.847772:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+10:6173:x1876180556848000:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 90us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265415.847779:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 267 00000100:00100000:3.0:1789265415.847811:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578933504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265415.847824:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3ad2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265415.847834:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3ad2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265415.847928:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578933632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.847948:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265415.847965:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377454f0300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265415.848035:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578933632 00000100:00100000:3.0:1789265415.848039:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578933632 00000100:00100000:3.0:1789265415.848057:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789265415.848063:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578933632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.848150:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578933632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265415.848155:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789265415.848175:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578933632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.848206:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578933760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.848237:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265415.848250:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377454f0300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265415.848263:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578933760 00000100:00100000:3.0:1789265415.848266:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578933760 00000100:00100000:3.0:1789265415.848283:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789265415.848287:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578933760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.848351:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578933760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265415.848357:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789265415.848393:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578933760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265415.852038:0:10468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10468:1876180578933888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265415.852137:0:10468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.852332:0:10468:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265415.853466:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578933888 00000100:00100000:1.0:1789265415.853476:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578933888 00000100:00100000:1.0:1789265415.853536:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789265415.853547:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:10468:x1876180578933888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265415.853697:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:10468:x1876180578933888:12345-0@lo:502:llog_process_th.0 Request processed in 152us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.853705:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789265415.853766:0:10468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10468:1876180578933888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265415.853807:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265415.853817:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265415.853820:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789265415.853826:0:10468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93774e5c3000 00000020:00000080:1.0:1789265415.853828:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789265415.853923:0:10468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10468:1876180578934016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265415.853957:0:10468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.853973:0:10468:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265415.857637:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578934016 00000100:00100000:1.0:1789265415.857654:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578934016 00000100:00100000:1.0:1789265415.857712:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789265415.857722:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+23:10468:x1876180578934016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265415.857915:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+23:10468:x1876180578934016:12345-0@lo:502:llog_process_th.0 Request processed in 194us (3956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.857923:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789265415.858625:0:10468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10468:1876180578934016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265415.858666:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265415.858675:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265415.858677:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789265415.858680:0:10468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789265415.859022:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789265415.859052:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265415.859063:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3ad2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265415.859074:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3ad2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265415.859084:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265415.859087:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff937779e62800 from 4 10000000:01000000:0.0:1789265415.859090:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265415.859121:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265415.859128:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265415.859137:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265415.859157:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578934144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265415.859215:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265415.859282:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578934144 00000100:00100000:3.0:1789265415.859295:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578934144 00000100:00100000:3.0:1789265415.859340:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789265415.859349:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578934144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265415.859362:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265415.859374:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ae0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3ad9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265415.859397:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3ad9 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265415.859406:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3ad9 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265415.859413:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219400, rc 0) 00000100:00100000:3.0:1789265415.859443:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578934144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265415.859449:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789265415.862655:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265415.862713:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578934144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265415.862742:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3ae0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265415.862755:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3ae0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265415.862843:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578934272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265415.864463:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265415.865124:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265415.866714:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578934272 00000100:00100000:3.0:1789265415.866730:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578934272 00000100:00100000:3.0:1789265415.866797:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789265415.866807:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578934272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.867004:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578934272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265415.867024:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789265415.867082:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578934272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.867137:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578934400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.867184:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265415.867251:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937747dd1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265415.867266:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578934400 00000100:00100000:3.0:1789265415.867270:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578934400 00000100:00100000:3.0:1789265415.867295:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789265415.867302:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578934400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265415.867380:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578934400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265415.867387:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789265415.867428:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578934400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265415.868250:0:10469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10469:1876180578934528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265415.868298:0:10469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.868331:0:10469:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265415.868541:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578934528 00000100:00100000:3.0:1789265415.868546:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578934528 00000100:00100000:3.0:1789265415.868588:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789265415.868595:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:10469:x1876180578934528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265415.868692:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:10469:x1876180578934528:12345-0@lo:502:llog_process_th.0 Request processed in 96us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265415.868700:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789265415.868783:0:10469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10469:1876180578934528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265415.868808:0:10469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265415.868818:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265415.868820:0:10469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789265415.868827:0:10469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff937779e62800 00000020:00000080:1.0:1789265415.868830:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789265415.868926:0:10469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10469:1876180578934656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265415.868962:0:10469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265415.868992:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578934656 00000100:00100000:1.0:1789265415.868996:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578934656 00000100:00100000:3.0:1789265415.869383:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789265415.869391:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:10469:x1876180578934656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265415.869460:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:10469:x1876180578934656:12345-0@lo:502:llog_process_th.0 Request processed in 70us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265415.869467:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789265415.869766:0:10469:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265415.869783:0:10469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:10469:1876180578934656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265415.876382:0:10469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265415.876397:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265415.876400:0:10469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789265415.876405:0:10469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789265415.876748:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789265415.876774:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265415.876787:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3ae0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265415.876799:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3ae0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265415.879186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265415.879232:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556848128 00000100:00100000:1.0:1789265415.879243:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556848128 00000100:00100000:1.0:1789265415.879303:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 277 00000100:00100000:1.0:1789265415.879314:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:6726:x1876180556848128:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265415.879474:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:6726:x1876180556848128:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 161us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.879483:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 277 00000100:00100000:1.0:1789265415.904748:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265415.906827:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556848256 00000100:00100000:3.0:1789265415.906842:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556848256 00000100:00100000:3.0:1789265415.906926:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 278 00000100:00100000:3.0:1789265415.906937:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+10:6726:x1876180556848256:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265415.907097:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+10:6726:x1876180556848256:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 162us (2361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265415.907114:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 278 00000100:00100000:1.0:1789265415.939280:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265415.939327:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556848512 00000100:00100000:1.0:1789265415.939338:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556848512 00000100:00100000:1.0:1789265415.939408:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 77 00000100:00100000:1.0:1789265415.939419:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556848512:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265415.939519:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556848512:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 100us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.939528:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 77 00000100:00080000:1.0:1789265415.939553:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265415.939586:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265415.939696:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265415.939720:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265415.939740:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556848768 00000100:00100000:1.0:1789265415.939743:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556848768 00000100:00100000:1.0:1789265415.939775:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556848640 00000100:00100000:1.0:1789265415.939778:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556848640 00000100:00100000:1.0:1789265415.939798:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:1.0:1789265415.939804:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556848768:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265415.939837:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556848768:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 33us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.939844:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:1.0:1789265415.939856:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:1.0:1789265415.939882:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377813b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556848640:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265415.939982:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377813b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556848640:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.939989:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:1.0:1789265415.940153:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556848384 00000100:00100000:1.0:1789265415.940157:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556848384 00000100:00100000:1.0:1789265415.940187:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 78 00000100:00100000:1.0:1789265415.940206:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2398:x1876180556848384:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265415.940233:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2398:x1876180556848384:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 40us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265415.940239:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 78 00000100:00080000:1.0:1789265415.940271:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265415.940275:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265415.940277:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265416.691181:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578934784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265416.691276:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265416.691278:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265416.691294:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578934912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265416.691323:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265416.691361:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578934784 00000100:00100000:1.0:1789265416.691361:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578934912 00000100:00100000:3.0:1789265416.691368:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578934784 00000100:00100000:1.0:1789265416.691368:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578934912 00000100:00100000:1.0:1789265416.691944:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265416.691956:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578934912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265416.691995:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265416.692053:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578934912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265416.692060:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789265416.692431:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789265416.692442:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578934784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265416.692477:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789265416.692524:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578934784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265416.692539:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789265416.692669:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578934912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265416.699937:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578934784:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789265416.756922:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265417.203511:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265417.203545:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578935040:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265417.203624:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265417.203701:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578935040 00000100:00100000:2.0:1789265417.203709:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578935040 00000100:00100000:2.0:1789265417.203775:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789265417.203786:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578935040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265417.203816:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265417.203887:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578935040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265417.203895:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789265417.203929:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36c000 x1876180578935040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265417.203945:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578935040:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789265417.204283:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265417.205002:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578935168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265417.205763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265417.205886:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578935168 00000100:00100000:2.0:1789265417.205893:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578935168 00000100:00100000:2.0:1789265417.206025:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789265417.206035:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578935168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265417.206057:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789265417.208344:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265417.209069:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578935168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3030us (3302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265417.209082:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789265417.210764:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376434d4380 x1876180578935168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265417.210794:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578935168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789265417.780631:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265418.811131:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265419.834938:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265420.281013:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578935296:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.281093:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.281281:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578935808:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.281309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.281330:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578936320:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.281353:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.281369:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578936832:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.281407:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.281431:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789265420.281438:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578935680:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.281463:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.281480:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578936192:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.281500:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.281517:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578936704:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.281538:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.281568:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578935424:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.281591:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.281607:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180578935936:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.281625:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.281640:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180578936448:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.281661:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.281679:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789265420.281685:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578935552:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.281707:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.281724:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578936064:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.281744:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.281754:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578936576:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.281771:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.281810:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578935296 00000100:00100000:1.0:1789265420.281817:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578935296 00000100:00100000:1.0:1789265420.281885:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789265420.281894:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180578935296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.281950:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180578935296:12345-0@lo:400:kworker.0 Request processed in 57us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.281959:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789265420.281993:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578935808 00000100:00100000:1.0:1789265420.281997:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578935808 00000100:00100000:1.0:1789265420.282019:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578935552 00000100:00100000:1.0:1789265420.282022:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578935552 00000100:00100000:1.0:1789265420.282037:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265420.282044:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578935808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.282077:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578935808:12345-0@lo:400:kworker.0 Request processed in 34us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.282083:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265420.282096:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789265420.282103:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578935552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.282133:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578935552:12345-0@lo:400:kworker.0 Request processed in 31us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.282140:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789265420.282170:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578936320 00000100:00100000:1.0:1789265420.282174:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578936320 00000100:00100000:1.0:1789265420.282202:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578936832 00000100:00100000:1.0:1789265420.282205:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578936832 00000100:00100000:1.0:1789265420.282216:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578936192 00000100:00100000:1.0:1789265420.282218:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578936192 00000100:00100000:1.0:1789265420.282231:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578936704 00000100:00100000:1.0:1789265420.282233:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578936704 00000100:00100000:1.0:1789265420.282246:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265420.282252:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578936320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.282282:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578936320:12345-0@lo:400:kworker.0 Request processed in 30us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.282294:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265420.282307:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265420.282313:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578936832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.282342:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578936832:12345-0@lo:400:kworker.0 Request processed in 30us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.282348:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265420.282359:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789265420.282364:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578936192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.282390:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578936192:12345-0@lo:400:kworker.0 Request processed in 26us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.282395:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789265420.282404:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789265420.282410:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578936704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.282435:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578936704:12345-0@lo:400:kworker.0 Request processed in 25us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.282440:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789265420.282461:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578935680 00000100:00100000:1.0:1789265420.282464:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578935680 00000100:00100000:1.0:1789265420.282481:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578935424 00000100:00100000:1.0:1789265420.282483:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578935424 00000100:00100000:1.0:1789265420.282493:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578935936 00000100:00100000:1.0:1789265420.282496:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578935936 00000100:00100000:1.0:1789265420.282507:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578936448 00000100:00100000:1.0:1789265420.282509:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578936448 00000100:00100000:1.0:1789265420.282521:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578936064 00000100:00100000:1.0:1789265420.282523:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578936064 00000100:00100000:1.0:1789265420.282533:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578936576 00000100:00100000:1.0:1789265420.282541:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578936576 00000100:00100000:1.0:1789265420.282557:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789265420.282563:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578935680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.282594:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578935680:12345-0@lo:400:kworker.0 Request processed in 31us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.282600:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789265420.282610:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265420.282616:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578935424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.282639:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578935424:12345-0@lo:400:kworker.0 Request processed in 24us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.282645:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265420.282657:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789265420.282662:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180578935936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.282684:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180578935936:12345-0@lo:400:kworker.0 Request processed in 22us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.282689:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789265420.282699:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789265420.282704:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180578936448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.282727:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180578936448:12345-0@lo:400:kworker.0 Request processed in 23us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.282732:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789265420.282742:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789265420.282748:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578936064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.282772:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578936064:12345-0@lo:400:kworker.0 Request processed in 24us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.282787:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789265420.282798:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789265420.282803:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578936576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.282831:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578936576:12345-0@lo:400:kworker.0 Request processed in 28us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265420.282836:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789265420.282904:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265420.282908:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265420.282910:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265420.282912:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265420.282944:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578935552:0@lo:400:kworker.0 00010000:00080000:1.0:1789265420.282957:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435eea00 x1876180578936064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265420.282965:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578936064:0@lo:400:kworker.0 00010000:00080000:1.0:1789265420.282973:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f37e300 x1876180578936576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265420.282980:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578936576:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.282988:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578935424:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.282995:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180578935936:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.283002:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180578936448:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.283046:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578935680:0@lo:400:kworker.0 00010000:00080000:1.0:1789265420.283057:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435ed880 x1876180578936192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265420.283072:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578936192:0@lo:400:kworker.0 00010000:00080000:1.0:1789265420.283083:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f37f800 x1876180578936704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265420.283091:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578936704:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.283100:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578935296:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.283108:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578935808:0@lo:400:kworker.0 00010000:00080000:1.0:1789265420.283116:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435ef100 x1876180578936320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265420.283122:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578936320:0@lo:400:kworker.0 00010000:00080000:1.0:1789265420.283130:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775285c000 x1876180578936832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265420.283135:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578936832:0@lo:400:kworker.0 00000100:00100000:1.0:1789265420.787666:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764354ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578936960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265420.787739:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265420.788945:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578937088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265420.788991:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265420.789078:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578936960 00000100:00100000:2.0:1789265420.789091:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578936960 00000100:00100000:2.0:1789265420.789130:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578937088 00000100:00100000:2.0:1789265420.789132:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578937088 00000100:00100000:2.0:1789265420.789145:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265420.789164:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578936960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265420.789194:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265420.789242:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578936960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265420.789248:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265420.789264:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265420.789270:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578937088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265420.789278:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265420.789301:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578937088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265420.789306:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789265420.789363:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36c000 x1876180578937088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265420.789381:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578937088:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789265420.789409:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764354ea00 x1876180578936960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265420.789427:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764354ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578936960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789265420.851947:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265421.066796:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265421.066835:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265421.066893:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265421.066918:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265421.066943:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265421.066972:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556849408 00000100:00100000:0.0:1789265421.066982:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556849408 00000100:00100000:0.0:1789265421.067043:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556849280 00000100:00100000:0.0:1789265421.067045:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556849280 00000100:00100000:0.0:1789265421.067070:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:0.0:1789265421.067081:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556849408:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265421.067179:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556849408:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 99us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265421.067187:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:0.0:1789265421.067204:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:0.0:1789265421.067211:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556849280:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265421.067235:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556849280:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265421.067242:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:0.0:1789265421.067260:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556849152 00000100:00100000:0.0:1789265421.067263:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556849152 00000100:00100000:0.0:1789265421.067307:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556849024 00000100:00100000:0.0:1789265421.067311:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556849024 00000100:00100000:0.0:1789265421.067331:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 85 00000100:00100000:0.0:1789265421.067338:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556849152:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265421.067366:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556849152:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 30us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265421.067373:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 85 00000100:00100000:0.0:1789265421.067384:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 86 00000100:00100000:0.0:1789265421.067390:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2399:x1876180556849024:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265421.067411:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2399:x1876180556849024:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265421.067417:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 86 00000100:00100000:2.0:1789265421.067692:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556848896 00000100:00100000:2.0:1789265421.067698:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556848896 00000100:00100000:2.0:1789265421.067741:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 280 00000100:00100000:2.0:1789265421.067749:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:2399:x1876180556848896:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265421.067777:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:2399:x1876180556848896:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 29us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265421.067783:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 280 00000100:00080000:0.0:1789265421.067956:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265421.067963:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265421.067966:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265421.067969:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1789265421.347712:0:10694:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1789265421.812126:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578937216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265421.812208:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265421.812505:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578937216 00000100:00100000:3.0:1789265421.812515:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578937216 00000100:00100000:3.0:1789265421.812568:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789265421.812578:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578937216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265421.812616:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265421.812674:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578937216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265421.812681:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789265421.812765:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578937216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265421.813541:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764354ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578937344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265421.813588:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265421.813716:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578937344 00000100:00100000:3.0:1789265421.813722:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578937344 00000100:00100000:3.0:1789265421.813761:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789265421.813769:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578937344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265421.813809:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789265421.814295:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578937344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 524us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265421.814305:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789265421.814518:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764354ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578937344:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789265421.875452:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265422.323103:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265422.323145:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578937472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265422.323244:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265422.323578:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578937472 00000100:00100000:2.0:1789265422.323589:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578937472 00000100:00100000:2.0:1789265422.323660:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265422.323670:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578937472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265422.323700:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265422.323743:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578937472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265422.323750:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789265422.323806:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265422.323885:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36fb80 x1876180578937472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265422.323905:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578937472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265422.325683:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265422.325713:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578937600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265422.325797:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265422.325965:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578937600 00000100:00100000:3.0:1789265422.325982:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578937600 00000100:00080000:0.0:1789265422.326043:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265422.326155:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789265422.326170:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578937600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265422.326207:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265422.326368:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578937600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 202us (571us total) trans 0 rc 0/0 00010000:00080000:0.0:1789265422.328425:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643641180 x1876180578937600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265422.328464:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578937600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265422.333585:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1789265422.902364:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265423.923027:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265424.947018:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265425.405749:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642750e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180578937856:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.405826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265425.405896:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180578938368:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.405921:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265425.405946:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764362bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876180578938880:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.405968:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265425.406010:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789265425.406017:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578937728:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406047:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265425.406067:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578938240:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265425.406121:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764362b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578938752:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406159:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265425.406178:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764362a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578939264:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265425.406226:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578937984:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406251:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265425.406271:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578938496:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406294:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265425.406312:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764362b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578939008:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406332:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265425.406345:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789265425.406350:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578938112:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406371:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265425.406381:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578938624:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406400:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265425.406417:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578939136:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406437:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265425.406472:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578937856 00000100:00100000:3.0:1789265425.406481:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578937856 00000100:00100000:3.0:1789265425.406520:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578938368 00000100:00100000:3.0:1789265425.406530:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578938368 00000100:00100000:3.0:1789265425.406556:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578938880 00000100:00100000:3.0:1789265425.406559:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578938880 00000100:00100000:3.0:1789265425.406573:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578938496 00000100:00100000:3.0:1789265425.406575:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578938496 00000100:00100000:3.0:1789265425.406587:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578939008 00000100:00100000:3.0:1789265425.406590:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578939008 00000100:00100000:3.0:1789265425.406602:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578938112 00000100:00100000:3.0:1789265425.406604:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578938112 00000100:00100000:3.0:1789265425.406618:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789265425.406627:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180578937856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406681:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180578937856:12345-0@lo:400:kworker.0 Request processed in 55us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265425.406689:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789265425.406709:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789265425.406715:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180578938368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406743:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180578938368:12345-0@lo:400:kworker.0 Request processed in 28us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265425.406749:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789265425.406763:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789265425.406769:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876180578938880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406796:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876180578938880:12345-0@lo:400:kworker.0 Request processed in 27us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265425.406802:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789265425.406814:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789265425.406820:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578938496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406853:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578938496:12345-0@lo:400:kworker.0 Request processed in 33us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265425.406893:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789265425.406905:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789265425.406911:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578939008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406943:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578939008:12345-0@lo:400:kworker.0 Request processed in 33us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265425.406949:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789265425.406960:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789265425.406965:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578938112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.406988:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578938112:12345-0@lo:400:kworker.0 Request processed in 24us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265425.406994:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789265425.407021:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578937728 00000100:00100000:3.0:1789265425.407024:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578937728 00000100:00100000:3.0:1789265425.407050:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789265425.407055:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180578937728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.407103:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180578937728:12345-0@lo:400:kworker.0 Request processed in 29us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265425.407116:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789265425.407149:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578938240 00000100:00100000:3.0:1789265425.407153:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578938240 00000100:00100000:3.0:1789265425.407175:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578937984 00000100:00100000:3.0:1789265425.407177:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578937984 00000100:00100000:3.0:1789265425.407188:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789265425.407194:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578938240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.407225:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578938240:12345-0@lo:400:kworker.0 Request processed in 31us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265425.407240:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789265425.407253:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789265425.407258:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578937984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.407291:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578937984:12345-0@lo:400:kworker.0 Request processed in 33us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265425.407297:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789265425.407316:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578938752 00000100:00100000:3.0:1789265425.407319:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578938752 00000100:00100000:3.0:1789265425.407339:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578939264 00000100:00100000:3.0:1789265425.407341:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578939264 00000100:00100000:3.0:1789265425.407351:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578938624 00000100:00100000:3.0:1789265425.407353:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578938624 00000100:00100000:3.0:1789265425.407362:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578939136 00000100:00100000:3.0:1789265425.407365:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578939136 00000100:00100000:3.0:1789265425.407377:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265425.407382:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578938752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.407411:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578938752:12345-0@lo:400:kworker.0 Request processed in 29us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265425.407416:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265425.407427:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789265425.407432:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578939264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.407457:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578939264:12345-0@lo:400:kworker.0 Request processed in 25us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265425.407463:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789265425.407474:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789265425.407479:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578938624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.407517:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578938624:12345-0@lo:400:kworker.0 Request processed in 38us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265425.407523:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789265425.407534:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265425.407539:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578939136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.407560:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578939136:12345-0@lo:400:kworker.0 Request processed in 21us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265425.407565:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789265425.407599:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265425.407603:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265425.407606:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265425.407607:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265425.407644:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578938112:0@lo:400:kworker.0 00010000:00080000:3.0:1789265425.407657:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642751f80 x1876180578938624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265425.407667:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578938624:0@lo:400:kworker.0 00010000:00080000:3.0:1789265425.407676:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643629880 x1876180578939136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265425.407684:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578939136:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.407692:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578937984:0@lo:400:kworker.0 00010000:00080000:3.0:1789265425.407701:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642750a80 x1876180578938496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265425.407709:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578938496:0@lo:400:kworker.0 00010000:00080000:3.0:1789265425.407718:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764362b100 x1876180578939008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265425.407733:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764362b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578939008:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.407777:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578937728:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.407788:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578938240:0@lo:400:kworker.0 00010000:00080000:3.0:1789265425.407797:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764362b800 x1876180578938752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265425.407806:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764362b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578938752:0@lo:400:kworker.0 00010000:00080000:3.0:1789265425.407816:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764362a300 x1876180578939264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265425.407823:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764362a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578939264:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.407833:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642750e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180578937856:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.407842:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180578938368:0@lo:400:kworker.0 00000100:00100000:3.0:1789265425.407850:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764362bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876180578938880:0@lo:400:kworker.0 00000100:00100000:1.0:1789265425.907546:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764354ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578939392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265425.907623:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265425.907701:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578939392 00000100:00100000:1.0:1789265425.907708:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578939392 00000100:00100000:1.0:1789265425.907756:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789265425.907765:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578939392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265425.907794:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265425.907838:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578939392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265425.907845:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789265425.907907:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764354ea00 x1876180578939392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265425.907926:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764354ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578939392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265425.908132:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265425.908142:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578939520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265425.908174:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265425.908223:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578939520 00000100:00100000:0.0:1789265425.908227:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578939520 00000100:00100000:0.0:1789265425.908253:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789265425.908260:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578939520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265425.908272:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265425.908317:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578939520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265425.908324:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789265425.908351:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643641180 x1876180578939520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265425.908364:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578939520:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789265425.981060:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265426.179292:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265426.179336:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265426.179363:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265426.179391:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556849536 00000100:00100000:3.0:1789265426.179400:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556849536 00000100:00100000:3.0:1789265426.179453:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 282 00000100:00100000:3.0:1789265426.179464:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+10:2397:x1876180556849536:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265426.179538:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+10:2397:x1876180556849536:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 75us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265426.179560:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 282 00000100:00100000:3.0:1789265426.179598:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556849792 00000100:00100000:3.0:1789265426.179602:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556849792 00000100:00100000:3.0:1789265426.179637:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556849664 00000100:00100000:3.0:1789265426.179641:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556849664 00000100:00100000:3.0:1789265426.179662:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 93 00000100:00100000:3.0:1789265426.179669:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556849792:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265426.179703:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556849792:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 35us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265426.179710:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 93 00000100:00100000:3.0:1789265426.179724:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 94 00000100:00100000:3.0:1789265426.179730:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2397:x1876180556849664:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265426.179753:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2397:x1876180556849664:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265426.179759:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 94 00000100:00080000:2.0:1789265426.181095:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265426.181114:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265426.190569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265426.194116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265426.203216:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556849920 00000100:00100000:2.0:1789265426.203232:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556849920 00000100:00100000:2.0:1789265426.203536:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556850048 00000100:00100000:2.0:1789265426.203541:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556850048 00000100:00100000:2.0:1789265426.203579:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:2.0:1789265426.203591:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2396:x1876180556849920:12345-192.168.202.42@tcp:9:kworker.0 00000020:00000080:2.0:1789265426.203630:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d39f2 00000100:00080000:2.0:1789265426.203640:0:8436:0:(import.c:65:import_set_state_nolock()) ffff93777f369800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265426.203697:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789265426.203891:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+2:2396:x1876180556849920:12345-192.168.202.42@tcp:9:kworker.0 Request processed in 302us (13332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265426.203899:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:2.0:1789265426.203918:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:2.0:1789265426.203926:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2396:x1876180556850048:12345-192.168.202.42@tcp:9:kworker.0 00000020:00000080:2.0:1789265426.203950:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d39f9 00000100:00080000:2.0:1789265426.203956:0:8436:0:(import.c:65:import_set_state_nolock()) ffff93777f36e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265426.203979:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1789265426.204023:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265426.204053:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+2:2396:x1876180556850048:12345-192.168.202.42@tcp:9:kworker.0 Request processed in 127us (9957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265426.204060:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00080000:2.0:1789265426.204079:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265426.204083:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265426.206047:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265426.931044:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578939648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265426.931129:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265426.932199:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578939648 00000100:00100000:3.0:1789265426.932208:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578939648 00000100:00100000:2.0:1789265426.932531:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265426.932548:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764362b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578939776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265426.932602:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265426.932702:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578939776 00000100:00100000:3.0:1789265426.932707:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578939776 00000100:00100000:3.0:1789265426.932728:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789265426.932737:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578939648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265426.932772:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789265426.932822:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578939648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265426.932830:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789265426.932888:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789265426.932896:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578939776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265426.932915:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265426.932948:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578939776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265426.932955:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789265426.933922:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578939648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265426.933969:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764362b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578939776:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789265426.996260:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265427.275059:0:10938:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing yml_node 00000100:00100000:1.0:1789265427.447263:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265427.447294:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764362b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578939904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265427.447387:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265427.447657:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578939904 00000100:00100000:0.0:1789265427.447667:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578939904 00000100:00100000:0.0:1789265427.447733:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265427.447743:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578939904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265427.447775:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265427.447829:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578939904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265427.447836:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789265427.447915:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764362b100 x1876180578939904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265427.447935:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764362b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578939904:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789265427.449551:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265427.452019:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265427.452046:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578940032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265427.455355:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265427.455628:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578940032 00000100:00100000:2.0:1789265427.455638:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578940032 00000100:00100000:2.0:1789265427.455712:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265427.455724:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578940032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265427.455749:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265427.455803:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578940032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265427.455819:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1789265427.455885:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36e300 x1876180578940032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265427.455907:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578940032:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789265427.456228:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265428.029146:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265429.044005:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265430.067159:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265430.515399:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578940288:0@lo:400:kworker.0 00000100:00100000:0.0:1789265430.515511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265430.515584:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578940800:0@lo:400:kworker.0 00000100:00100000:0.0:1789265430.515618:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265430.515639:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180578941312:0@lo:400:kworker.0 00000100:00100000:0.0:1789265430.515659:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265430.515685:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789265430.515691:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578940416:0@lo:400:kworker.0 00000100:00100000:0.0:1789265430.515715:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265430.515731:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578940928:0@lo:400:kworker.0 00000100:00100000:0.0:1789265430.515750:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265430.515762:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180578941440:0@lo:400:kworker.0 00000100:00100000:0.0:1789265430.515779:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265430.516092:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578940288 00000100:00100000:1.0:1789265430.516101:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578940288 00000100:00100000:1.0:1789265430.516138:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578940800 00000100:00100000:1.0:1789265430.516142:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578940800 00000100:00100000:1.0:1789265430.516173:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578941312 00000100:00100000:1.0:1789265430.516176:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578941312 00000100:00100000:1.0:1789265430.516189:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578940928 00000100:00100000:1.0:1789265430.516191:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578940928 00000100:00100000:1.0:1789265430.516202:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578941440 00000100:00100000:1.0:1789265430.516204:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578941440 00000100:00100000:1.0:1789265430.516220:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789265430.516228:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578940288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265430.516300:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578940288:12345-0@lo:400:kworker.0 Request processed in 72us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265430.516307:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789265430.516323:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789265430.516330:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578940800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265430.516355:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578940800:12345-0@lo:400:kworker.0 Request processed in 27us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265430.516361:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789265430.516372:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789265430.516379:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180578941312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265430.516401:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180578941312:12345-0@lo:400:kworker.0 Request processed in 24us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265430.516407:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789265430.516585:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789265430.516659:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578940928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265430.516687:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578940928:12345-0@lo:400:kworker.0 Request processed in 32us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265430.516701:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789265430.516713:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789265430.516719:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180578941440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265430.516746:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180578941440:12345-0@lo:400:kworker.0 Request processed in 28us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265430.516752:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1789265430.516794:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435ed180 x1876180578940928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265430.516807:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578940928:0@lo:400:kworker.0 00010000:00080000:1.0:1789265430.516818:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435eea00 x1876180578941440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265430.516826:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180578941440:0@lo:400:kworker.0 00000100:00100000:1.0:1789265430.516835:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578940288:0@lo:400:kworker.0 00000100:00100000:1.0:1789265430.516844:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578940800:0@lo:400:kworker.0 00000100:00100000:1.0:1789265430.516852:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180578941312:0@lo:400:kworker.0 00000100:00080000:0.0:1789265430.516983:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265430.516987:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265430.517168:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578940160:0@lo:400:kworker.0 00000100:00100000:2.0:1789265430.517206:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265430.517247:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578940672:0@lo:400:kworker.0 00000100:00100000:2.0:1789265430.517355:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265430.517375:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578941184:0@lo:400:kworker.0 00000100:00100000:2.0:1789265430.517399:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265430.517723:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578940544:0@lo:400:kworker.0 00000100:00100000:3.0:1789265430.517754:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265430.517774:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578941056:0@lo:400:kworker.0 00000100:00100000:3.0:1789265430.517792:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265430.517808:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578941568:0@lo:400:kworker.0 00000100:00100000:3.0:1789265430.517828:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265430.517890:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578940544 00000100:00100000:3.0:1789265430.517895:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578940544 00000100:00100000:2.0:1789265430.518132:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376426dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578941696:0@lo:400:kworker.0 00000100:00100000:2.0:1789265430.518158:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265430.518198:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578941184 00000100:00100000:2.0:1789265430.518202:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578941184 00000100:00100000:2.0:1789265430.518236:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578941056 00000100:00100000:2.0:1789265430.518239:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578941056 00000100:00100000:2.0:1789265430.518252:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578941568 00000100:00100000:2.0:1789265430.518254:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578941568 00000100:00100000:2.0:1789265430.518264:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578941696 00000100:00100000:3.0:1789265430.518579:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789265430.518587:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578940544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265430.518703:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578940160 00000100:00100000:0.0:1789265430.518708:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578940160 00000100:00100000:0.0:1789265430.518739:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789265430.518746:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578940160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265430.518801:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578940160:12345-0@lo:400:kworker.0 Request processed in 56us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265430.518808:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789265430.518843:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789265430.518850:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578941184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265430.518991:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578941184:12345-0@lo:400:kworker.0 Request processed in 142us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265430.519009:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789265430.519021:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789265430.519024:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578941056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265430.519050:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578941056:12345-0@lo:400:kworker.0 Request processed in 26us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265430.519054:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789265430.519073:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789265430.519080:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578941568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265430.519109:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578941568:12345-0@lo:400:kworker.0 Request processed in 30us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265430.519115:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1789265430.519135:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265430.519139:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265430.519377:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578940416 00000100:00100000:1.0:1789265430.519382:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578940416 00000100:00100000:1.0:1789265430.519410:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578940672 00000100:00100000:3.0:1789265430.519692:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578940544:12345-0@lo:400:kworker.0 Request processed in 1106us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265430.519700:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789265430.519747:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578940544:0@lo:400:kworker.0 00010000:00080000:3.0:1789265430.519761:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435efb80 x1876180578941056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265430.519771:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578941056:0@lo:400:kworker.0 00010000:00080000:3.0:1789265430.519782:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435ed500 x1876180578941568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265430.519800:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578941568:0@lo:400:kworker.0 00000100:00100000:3.0:1789265430.519837:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789265430.519845:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578940416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265430.519976:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578940672 00000100:00100000:1.0:1789265430.519997:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789265430.520002:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578940672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265430.520036:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578940672:12345-0@lo:400:kworker.0 Request processed in 33us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265430.520053:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789265430.520111:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578940160:0@lo:400:kworker.0 00000100:00100000:1.0:1789265430.520124:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578940672:0@lo:400:kworker.0 00010000:00080000:1.0:1789265430.520135:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435edf80 x1876180578941184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265430.520145:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578941184:0@lo:400:kworker.0 00000100:00100000:1.0:1789265430.520185:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578940416:0@lo:400:kworker.0 00000100:00100000:3.0:1789265430.520382:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578940416:12345-0@lo:400:kworker.0 Request processed in 53us (4181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265430.520390:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789265430.520503:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578941696 00000100:00100000:2.0:1789265430.520545:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789265430.520552:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578941696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265430.520590:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578941696:12345-0@lo:400:kworker.0 Request processed in 39us (2430us total) trans 0 rc 0/0 00010000:00080000:0.0:1789265430.520698:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376426dc380 x1876180578941696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265430.520704:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789265430.520709:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376426dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578941696:0@lo:400:kworker.0 00000100:00080000:1.0:1789265430.520758:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265431.027276:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265431.028116:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578941952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265431.028195:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265431.028275:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578941952 00000100:00100000:2.0:1789265431.028285:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578941952 00000100:00100000:2.0:1789265431.028332:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789265431.028342:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578941952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265431.028381:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265431.028428:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578941952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265431.028435:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1789265431.028841:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643643b80 x1876180578941952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265431.028880:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578941952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265431.028888:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578941824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265431.028918:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265431.029010:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578941824 00000100:00100000:2.0:1789265431.029014:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578941824 00000100:00100000:2.0:1789265431.029032:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789265431.029038:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578941824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265431.029048:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265431.029096:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578941824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265431.029102:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789265431.029165:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643643800 x1876180578941824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265431.029178:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578941824:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789265431.096019:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265431.299640:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265431.299756:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265431.299854:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265431.301137:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556850304 00000100:00100000:2.0:1789265431.301151:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556850304 00000100:00100000:2.0:1789265431.301212:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556850432 00000100:00100000:2.0:1789265431.301216:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556850432 00000100:00100000:2.0:1789265431.301243:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 101 00000100:00100000:2.0:1789265431.301254:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2399:x1876180556850304:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265431.301347:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2399:x1876180556850304:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 93us (1588us total) trans 0 rc 0/0 00000100:00080000:3.0:1789265431.301370:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265431.301378:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265431.301419:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 102 00000100:00100000:3.0:1789265431.301452:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556850432:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265431.301522:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556850432:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 77us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265431.301530:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 102 00000100:00100000:0.0:1789265431.303636:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556850176 00000100:00100000:0.0:1789265431.303655:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556850176 00000100:00100000:0.0:1789265431.303706:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 284 00000100:00100000:0.0:1789265431.303716:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+10:2400:x1876180556850176:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265431.303793:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+10:2400:x1876180556850176:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 79us (4168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265431.303801:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 284 00000100:00100000:2.0:1789265431.310507:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 101 00000001:02000400:2.0:1789265432.032396:0:11122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.106 00000001:00100000:2.0:1789265432.053632:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f16c02c5-6a63-4180-875a-2aaaca684c23 00000020:00000080:2.0:1789265432.053644:0:9512:0:(genops.c:885:class_export_put()) final put ffff93777f369000/f16c02c5-6a63-4180-875a-2aaaca684c23 00000020:00000080:3.0:1789265432.053834:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93777f369000/f16c02c5-6a63-4180-875a-2aaaca684c23 for lustre-OST0001 00000020:00000080:3.0:1789265432.053966:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93777f36e000 for lustre-OST0001 00000100:00100000:3.0:1789265432.054995:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578942080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265432.055225:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265432.055637:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265432.055647:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578942208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265432.055678:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:3.0:1789265432.060954:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f16c02c5-6a63-4180-875a-2aaaca684c23 00000020:00000080:3.0:1789265432.060967:0:8429:0:(genops.c:885:class_export_put()) final put ffff93777f36f000/f16c02c5-6a63-4180-875a-2aaaca684c23 00000020:00000080:3.0:1789265432.061003:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93777f36f000/f16c02c5-6a63-4180-875a-2aaaca684c23 for lustre-OST0000 00000020:00000080:3.0:1789265432.061076:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93777f369800 for lustre-OST0000 00000100:00100000:2.0:1789265432.061261:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578942080 00000100:00100000:2.0:1789265432.061283:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578942080 00000100:00100000:1.0:1789265432.061455:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578942208 00000100:00100000:1.0:1789265432.061460:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578942208 00000100:00100000:1.0:1789265432.061504:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789265432.061515:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578942080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265432.061566:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265432.061673:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578942080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (6449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265432.061681:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789265432.061700:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789265432.061706:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578942208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265432.061725:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265432.061755:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578942208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (6077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265432.061761:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789265432.062061:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578942208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265432.062081:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578942080:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789265432.118677:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265432.563461:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578942336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265432.563567:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265432.564106:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578942336 00000100:00100000:0.0:1789265432.564135:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578942336 00000100:00100000:0.0:1789265432.564230:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789265432.564244:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578942336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265432.564285:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265432.564355:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578942336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265432.564363:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789265432.564390:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265432.564426:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642752a00 x1876180578942336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265432.564448:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578942336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265432.565545:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578942464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265432.565613:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265432.568152:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578942464 00000100:00100000:1.0:1789265432.568181:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578942464 00000100:00100000:1.0:1789265432.568286:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265432.568298:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578942464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265432.568334:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789265432.568723:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265432.573451:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578942464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5140us (7822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265432.573471:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1789265432.574719:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642751500 x1876180578942464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265432.574754:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578942464:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789265433.140626:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265434.163091:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265434.742048:0:11219:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.106 00010000:00010000:2.0:1789265435.187496:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265435.636211:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578942848:0@lo:400:kworker.0 00000100:00100000:0.0:1789265435.636281:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265435.636331:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578943360:0@lo:400:kworker.0 00000100:00100000:0.0:1789265435.636355:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265435.636374:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180578943872:0@lo:400:kworker.0 00000100:00100000:0.0:1789265435.636395:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265435.636419:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789265435.636425:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578942976:0@lo:400:kworker.0 00000100:00100000:0.0:1789265435.636471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265435.636489:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578943488:0@lo:400:kworker.0 00000100:00100000:0.0:1789265435.636509:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265435.636530:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578944000:0@lo:400:kworker.0 00000100:00100000:0.0:1789265435.636546:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265435.636596:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578942848 00000100:00100000:0.0:1789265435.636605:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578942848 00000100:00100000:0.0:1789265435.636654:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789265435.636663:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578942848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265435.636719:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578942848:12345-0@lo:400:kworker.0 Request processed in 57us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265435.636727:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789265435.636750:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578943360 00000100:00100000:0.0:1789265435.636753:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578943360 00000100:00100000:0.0:1789265435.636789:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578943872 00000100:00100000:0.0:1789265435.636792:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578943872 00000100:00100000:0.0:1789265435.636807:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578942976 00000100:00100000:0.0:1789265435.636809:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578942976 00000100:00100000:0.0:1789265435.636822:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789265435.636829:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578943360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265435.636897:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578943360:12345-0@lo:400:kworker.0 Request processed in 68us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265435.636904:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789265435.636917:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789265435.636923:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180578943872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265435.636951:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180578943872:12345-0@lo:400:kworker.0 Request processed in 28us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265435.636966:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789265435.636978:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789265435.636984:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578942976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265435.637024:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578942976:12345-0@lo:400:kworker.0 Request processed in 40us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265435.637030:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789265435.637055:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578943488 00000100:00100000:0.0:1789265435.637059:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578943488 00000100:00100000:0.0:1789265435.637082:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578944000 00000100:00100000:0.0:1789265435.637084:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578944000 00000100:00100000:0.0:1789265435.637102:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265435.637108:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578943488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265435.637139:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578943488:12345-0@lo:400:kworker.0 Request processed in 31us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265435.637145:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265435.637157:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789265435.637162:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578944000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265435.637191:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578944000:12345-0@lo:400:kworker.0 Request processed in 30us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265435.637198:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1789265435.637221:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265435.637225:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265435.637227:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265435.637264:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578942976:0@lo:400:kworker.0 00010000:00080000:0.0:1789265435.637277:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643643b80 x1876180578943488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265435.637300:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578943488:0@lo:400:kworker.0 00010000:00080000:0.0:1789265435.637312:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643caca80 x1876180578944000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265435.637321:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578944000:0@lo:400:kworker.0 00000100:00100000:0.0:1789265435.637330:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578942848:0@lo:400:kworker.0 00010000:00080000:0.0:1789265435.637339:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643643800 x1876180578943360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265435.637347:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578943360:0@lo:400:kworker.0 00010000:00080000:0.0:1789265435.637356:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643cadc00 x1876180578943872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265435.637364:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180578943872:0@lo:400:kworker.0 00000100:00100000:2.0:1789265435.637731:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578942720:0@lo:400:kworker.0 00000100:00100000:2.0:1789265435.637768:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265435.637787:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578943232:0@lo:400:kworker.0 00000100:00100000:2.0:1789265435.637807:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265435.637823:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578943744:0@lo:400:kworker.0 00000100:00100000:2.0:1789265435.637840:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265435.637855:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1789265435.637878:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578942592:0@lo:400:kworker.0 00000100:00100000:2.0:1789265435.637907:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265435.637932:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578943104:0@lo:400:kworker.0 00000100:00100000:2.0:1789265435.637953:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265435.637971:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578943616:0@lo:400:kworker.0 00000100:00100000:2.0:1789265435.637991:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265435.638022:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578944128:0@lo:400:kworker.0 00000100:00100000:2.0:1789265435.638042:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265435.638076:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578942592 00000100:00100000:2.0:1789265435.638080:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578942592 00000100:00100000:2.0:1789265435.638110:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789265435.638116:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578942592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265435.638150:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578942592:12345-0@lo:400:kworker.0 Request processed in 35us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265435.638157:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789265435.638186:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578943104 00000100:00100000:2.0:1789265435.638189:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578943104 00000100:00100000:2.0:1789265435.638208:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789265435.638214:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578943104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265435.638241:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578943104:12345-0@lo:400:kworker.0 Request processed in 28us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265435.638247:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789265435.638271:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578942592:0@lo:400:kworker.0 00000100:00100000:2.0:1789265435.638281:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578943104:0@lo:400:kworker.0 00000100:00100000:0.0:1789265435.638724:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578942720 00000100:00100000:0.0:1789265435.638729:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578942720 00000100:00100000:0.0:1789265435.639664:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578943232 00000100:00100000:0.0:1789265435.639671:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578943232 00000100:00080000:2.0:1789265435.639754:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265435.641887:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578943744 00000100:00100000:1.0:1789265435.641900:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578943744 00000100:00100000:1.0:1789265435.641960:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789265435.641971:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578942720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265435.642096:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578942720:12345-0@lo:400:kworker.0 Request processed in 127us (4326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265435.642104:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789265435.642122:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789265435.642130:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578943232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265435.642160:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578943232:12345-0@lo:400:kworker.0 Request processed in 31us (4352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265435.642166:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789265435.642177:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789265435.642183:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578943744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265435.642210:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578943744:12345-0@lo:400:kworker.0 Request processed in 28us (4369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265435.642215:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789265435.642262:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578942720:0@lo:400:kworker.0 00000100:00100000:1.0:1789265435.642290:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578943232:0@lo:400:kworker.0 00000100:00100000:1.0:1789265435.642299:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578943744:0@lo:400:kworker.0 00000100:00080000:2.0:1789265435.644218:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265435.644932:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578943616 00000100:00100000:2.0:1789265435.644944:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578943616 00000100:00100000:2.0:1789265435.645027:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578944128 00000100:00100000:2.0:1789265435.645031:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578944128 00000100:00100000:2.0:1789265435.645062:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789265435.645074:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578943616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265435.645167:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578943616:12345-0@lo:400:kworker.0 Request processed in 95us (7174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265435.645174:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789265435.645204:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789265435.645211:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578944128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265435.645244:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578944128:12345-0@lo:400:kworker.0 Request processed in 35us (7201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265435.645251:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789265435.645275:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265435.645278:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265435.645311:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643cae300 x1876180578943616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265435.645328:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578943616:0@lo:400:kworker.0 00010000:00080000:2.0:1789265435.645342:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643cad500 x1876180578944128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265435.645351:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578944128:0@lo:400:kworker.0 00000100:00100000:1.0:1789265436.147190:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265436.147216:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578944256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265436.147797:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265436.147811:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578944384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265436.147850:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265436.148485:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578944384 00000100:00100000:2.0:1789265436.148494:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578944384 00000100:00100000:1.0:1789265436.148718:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265436.148809:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578944256 00000100:00100000:2.0:1789265436.148813:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578944256 00000100:00100000:2.0:1789265436.148831:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789265436.148840:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578944384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265436.148888:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265436.148948:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578944384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265436.148955:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789265436.148974:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789265436.148980:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578944256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265436.148989:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265436.149049:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578944256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265436.149056:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1789265436.149261:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643cadc00 x1876180578944384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265436.149294:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578944384:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789265436.149879:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642751500 x1876180578944256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265436.149896:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578944256:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265436.211811:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265436.416137:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265436.416183:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265436.416222:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265436.416309:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556850816 00000100:00100000:3.0:1789265436.416333:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556850816 00000100:00100000:3.0:1789265436.416403:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556850688 00000100:00100000:3.0:1789265436.416407:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556850688 00000100:00100000:3.0:1789265436.416440:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 109 00000100:00100000:3.0:1789265436.416450:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556850816:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265436.416543:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556850816:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 94us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265436.416560:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 109 00000100:00100000:3.0:1789265436.416578:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 110 00000100:00100000:3.0:1789265436.416585:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2398:x1876180556850688:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265436.416610:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2398:x1876180556850688:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265436.416617:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 110 00000100:00080000:0.0:1789265436.417344:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265436.417350:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265436.417437:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556850560 00000100:00100000:1.0:1789265436.417446:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556850560 00000100:00100000:1.0:1789265436.417493:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 286 00000100:00100000:1.0:1789265436.417514:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:2398:x1876180556850560:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265436.418055:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:2398:x1876180556850560:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 554us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265436.418063:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 286 00000100:00100000:3.0:1789265437.172835:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265437.172877:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578944512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265437.172950:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265437.173308:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578944512 00000100:00100000:0.0:1789265437.173326:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578944512 00000100:00100000:0.0:1789265437.173379:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789265437.173389:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578944512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265437.173425:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789265437.173479:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578944512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265437.173486:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789265437.173530:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578944512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265437.174627:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265437.174642:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376426dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578944640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265437.174701:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265437.174746:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578944640 00000100:00100000:1.0:1789265437.174752:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578944640 00000100:00100000:1.0:1789265437.174785:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789265437.174792:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578944640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265437.174816:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265437.174854:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578944640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265437.174885:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789265437.174922:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376426dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578944640:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789265437.235302:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789265437.321841:0:11317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.106 00000100:00100000:0.0:1789265437.683060:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265437.683086:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578944768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265437.683159:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265437.683341:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265437.683352:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578944896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265437.683403:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265437.683555:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578944768 00000100:00100000:2.0:1789265437.683564:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578944768 00000100:00100000:1.0:1789265437.683758:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578944896 00000100:00100000:1.0:1789265437.683763:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578944896 00000100:00100000:1.0:1789265437.683800:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265437.683810:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578944896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265437.683839:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265437.683926:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578944896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265437.683933:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1789265437.684026:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642751500 x1876180578944896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265437.684045:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578944896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265437.684130:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265437.684138:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578944768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265437.684148:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265437.684193:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578944768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265437.684200:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1789265437.684351:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265437.684412:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643cae680 x1876180578944768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265437.684426:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578944768:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789265438.259405:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265439.209761:0:11365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 12 22:10:38 EDT 2026 00010000:00010000:0.0:1789265439.283651:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265440.310931:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265440.758062:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578945024:0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.758143:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265440.758202:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578945536:0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.758229:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265440.758247:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578946048:0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.758267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265440.758282:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578946560:0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.758300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265440.758316:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789265440.758321:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578945408:0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.758330:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578945152:0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.758353:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265440.758365:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578945536 00000100:00100000:2.0:1789265440.758371:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578945920:0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.758372:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578945536 00000100:00100000:2.0:1789265440.758390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265440.758404:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578946432:0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.758423:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789265440.758423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265440.758433:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578945536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.758444:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578945280:0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.758470:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265440.758504:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578945792:0@lo:400:kworker.0 00000100:00100000:1.0:1789265440.758542:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578945280 00000100:00100000:1.0:1789265440.758547:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578945280 00000100:00100000:1.0:1789265440.758570:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789265440.758576:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578945280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.758623:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578945536:12345-0@lo:400:kworker.0 Request processed in 191us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265440.758637:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789265440.758661:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578945408 00000100:00100000:3.0:1789265440.758664:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578945408 00000100:00100000:3.0:1789265440.758691:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789265440.758698:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578945408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.758744:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578945408:12345-0@lo:400:kworker.0 Request processed in 47us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265440.758750:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789265440.758771:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265440.759662:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265440.759694:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180578946304:0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.759738:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265440.759783:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578945024 00000100:00100000:2.0:1789265440.759789:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578945024 00000100:00100000:2.0:1789265440.759827:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789265440.759834:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180578945024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.759893:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180578945024:12345-0@lo:400:kworker.0 Request processed in 58us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265440.759900:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789265440.759936:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578946048 00000100:00100000:2.0:1789265440.759940:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578946048 00000100:00100000:2.0:1789265440.759981:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578946560 00000100:00100000:2.0:1789265440.759984:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578946560 00000100:00100000:2.0:1789265440.760000:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578945920 00000100:00100000:2.0:1789265440.760003:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578945920 00000100:00100000:2.0:1789265440.760013:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578946432 00000100:00100000:2.0:1789265440.760016:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578946432 00000100:00100000:2.0:1789265440.760030:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789265440.760045:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578946048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.760081:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578946048:12345-0@lo:400:kworker.0 Request processed in 37us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265440.760087:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789265440.760101:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789265440.760106:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578946560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.760131:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578946560:12345-0@lo:400:kworker.0 Request processed in 25us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265440.760136:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789265440.760146:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789265440.760152:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578945920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.760178:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578945920:12345-0@lo:400:kworker.0 Request processed in 26us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265440.760184:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789265440.760196:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789265440.760202:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578946432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.760229:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578946432:12345-0@lo:400:kworker.0 Request processed in 28us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265440.760234:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789265440.760278:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578945152 00000100:00100000:2.0:1789265440.760282:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578945152 00000100:00100000:2.0:1789265440.760307:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578945792 00000100:00100000:2.0:1789265440.760309:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578945792 00000100:00100000:2.0:1789265440.760322:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578946304 00000100:00100000:2.0:1789265440.760324:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578946304 00000100:00100000:2.0:1789265440.760336:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789265440.760342:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578945152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.760393:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578945152:12345-0@lo:400:kworker.0 Request processed in 51us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265440.760399:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789265440.760411:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789265440.760416:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578945792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.760447:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578945792:12345-0@lo:400:kworker.0 Request processed in 32us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265440.760453:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789265440.760465:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789265440.760471:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180578946304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265440.760498:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180578946304:12345-0@lo:400:kworker.0 Request processed in 28us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265440.760504:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:2.0:1789265440.760545:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f385f80 x1876180578945792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265440.760558:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578945792:0@lo:400:kworker.0 00010000:00080000:2.0:1789265440.760568:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f384700 x1876180578946304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265440.760576:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180578946304:0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.761328:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578945152:0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.761338:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180578945664:0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.761375:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265440.761403:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180578946176:0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.761426:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265440.761469:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578945664 00000100:00100000:3.0:1789265440.761474:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578945664 00000100:00100000:3.0:1789265440.761505:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578946176 00000100:00100000:3.0:1789265440.761508:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578946176 00000100:00100000:3.0:1789265440.761525:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789265440.761532:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180578945664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.761576:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180578945664:12345-0@lo:400:kworker.0 Request processed in 43us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265440.761582:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789265440.761596:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789265440.761602:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180578946176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.761645:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180578946176:12345-0@lo:400:kworker.0 Request processed in 44us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265440.761652:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1789265440.761670:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265440.761675:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265440.761678:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265440.761680:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265440.761727:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578945408:0@lo:400:kworker.0 00010000:00080000:3.0:1789265440.761745:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f386a00 x1876180578945920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265440.761755:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578945920:0@lo:400:kworker.0 00010000:00080000:3.0:1789265440.761766:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f384000 x1876180578946432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265440.761773:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578946432:0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.761794:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578945536:0@lo:400:kworker.0 00010000:00080000:3.0:1789265440.761807:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f384380 x1876180578946048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265440.761816:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578946048:0@lo:400:kworker.0 00010000:00080000:3.0:1789265440.761827:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f386680 x1876180578946560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265440.761834:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578946560:0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.761845:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578945024:0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.761904:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180578945664:0@lo:400:kworker.0 00000100:00100000:3.0:1789265440.761923:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180578946176:0@lo:400:kworker.0 00000100:00100000:0.0:1789265440.779091:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578945280:12345-0@lo:400:kworker.0 Request processed in 20507us (20612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265440.779104:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789265440.779160:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578945280:0@lo:400:kworker.0 00000100:00100000:0.0:1789265441.267909:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265441.267934:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578946688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265441.268024:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265441.268100:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578946688 00000100:00100000:0.0:1789265441.268107:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578946688 00000100:00100000:0.0:1789265441.268157:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789265441.268167:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578946688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265441.268195:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265441.268241:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578946688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265441.268249:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1789265441.268294:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643cafb80 x1876180578946688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265441.268313:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578946688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265441.269909:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578946816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265441.269988:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265441.270220:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578946816 00000100:00100000:2.0:1789265441.270228:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578946816 00000100:00100000:2.0:1789265441.270267:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789265441.270275:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578946816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265441.270295:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265441.270355:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578946816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265441.270363:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789265441.270441:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f29b100 x1876180578946816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265441.270458:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578946816:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789265441.338835:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265441.533189:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265441.533238:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265441.533273:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265441.533326:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556850944 00000100:00100000:2.0:1789265441.533336:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556850944 00000100:00100000:2.0:1789265441.533401:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 288 00000100:00100000:2.0:1789265441.533411:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:2398:x1876180556850944:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265441.533483:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:2398:x1876180556850944:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 74us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265441.533492:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 288 00000100:00100000:3.0:1789265441.533587:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556851072 00000100:00100000:3.0:1789265441.533592:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556851072 00000100:00100000:3.0:1789265441.533646:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556851200 00000100:00100000:3.0:1789265441.533649:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556851200 00000100:00100000:3.0:1789265441.533674:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 117 00000100:00100000:3.0:1789265441.533680:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2398:x1876180556851072:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265441.533735:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2398:x1876180556851072:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 54us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265441.533742:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 117 00000100:00100000:3.0:1789265441.533756:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 118 00000100:00100000:3.0:1789265441.533762:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556851200:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265441.533788:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556851200:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265441.533794:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 118 00000100:00080000:2.0:1789265441.534210:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265441.534214:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265442.291070:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265442.291096:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376426de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578946944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265442.291168:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265442.291320:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578946944 00000100:00100000:1.0:1789265442.291328:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578946944 00000100:00100000:1.0:1789265442.291393:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789265442.291404:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578946944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265442.291436:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265442.291739:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578946944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 336us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265442.291747:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789265442.292044:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265442.292056:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578947072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265442.292087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265442.292313:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578947072 00000100:00100000:3.0:1789265442.292318:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578947072 00000100:00100000:3.0:1789265442.292362:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789265442.292369:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578947072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265442.292389:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789265442.292469:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578947072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265442.292482:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789265442.293558:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376426de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578946944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265442.296071:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578947072:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789265442.356005:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265442.810421:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578947200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265442.810499:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265442.810583:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578947200 00000100:00100000:1.0:1789265442.810590:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578947200 00000100:00100000:1.0:1789265442.810644:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789265442.810654:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578947200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265442.810689:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265442.810738:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578947200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265442.810745:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1789265442.810769:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265442.810801:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643cad500 x1876180578947200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265442.810819:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578947200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265442.812191:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578947328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265442.812246:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265442.812305:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578947328 00000100:00100000:3.0:1789265442.812311:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578947328 00000100:00100000:3.0:1789265442.812373:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789265442.812381:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578947328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265442.812400:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265442.812454:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578947328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265442.812461:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789265442.812483:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265442.812510:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f386d80 x1876180578947328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265442.812527:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578947328:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789265443.379081:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265444.403491:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265445.427040:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265445.876239:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578947840:0@lo:400:kworker.0 00000100:00100000:3.0:1789265445.876330:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265445.876385:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578948352:0@lo:400:kworker.0 00000100:00100000:3.0:1789265445.876413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265445.876438:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578948864:0@lo:400:kworker.0 00000100:00100000:3.0:1789265445.876458:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265445.876488:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789265445.876494:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578947712:0@lo:400:kworker.0 00000100:00100000:3.0:1789265445.876533:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265445.876558:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578948224:0@lo:400:kworker.0 00000100:00100000:3.0:1789265445.876581:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265445.876596:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180578948736:0@lo:400:kworker.0 00000100:00100000:3.0:1789265445.876614:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265445.876641:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578947840 00000100:00100000:3.0:1789265445.876648:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578947840 00000100:00100000:3.0:1789265445.876690:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578948224 00000100:00100000:3.0:1789265445.876693:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578948224 00000100:00100000:3.0:1789265445.876711:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578948736 00000100:00100000:3.0:1789265445.876713:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578948736 00000100:00100000:3.0:1789265445.876727:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789265445.876888:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764355b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578947840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265445.877016:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764355b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578947840:12345-0@lo:400:kworker.0 Request processed in 280us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265445.877024:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789265445.877044:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789265445.877050:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764355b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578948224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265445.877076:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764355b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578948224:12345-0@lo:400:kworker.0 Request processed in 27us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265445.877082:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789265445.877092:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789265445.877097:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764355bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180578948736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265445.877119:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764355bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180578948736:12345-0@lo:400:kworker.0 Request processed in 22us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265445.877124:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789265445.877142:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578948352 00000100:00100000:3.0:1789265445.877146:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578948352 00000100:00100000:3.0:1789265445.877179:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578948864 00000100:00100000:3.0:1789265445.877181:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578948864 00000100:00100000:3.0:1789265445.877195:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265445.877200:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578948352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265445.877226:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578948352:12345-0@lo:400:kworker.0 Request processed in 27us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265445.877232:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265445.877242:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789265445.877247:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578948864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265445.877267:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578948864:12345-0@lo:400:kworker.0 Request processed in 21us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265445.877272:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1789265445.877295:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265445.877298:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265445.877300:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789265445.877329:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f385500 x1876180578948224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265445.877343:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578948224:0@lo:400:kworker.0 00010000:00080000:3.0:1789265445.877352:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f384a80 x1876180578948736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265445.877359:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180578948736:0@lo:400:kworker.0 00000100:00100000:3.0:1789265445.877368:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578947840:0@lo:400:kworker.0 00010000:00080000:3.0:1789265445.877376:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f385c00 x1876180578948352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265445.877382:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578948352:0@lo:400:kworker.0 00010000:00080000:3.0:1789265445.877401:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f384700 x1876180578948864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265445.877409:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578948864:0@lo:400:kworker.0 00000100:00100000:1.0:1789265445.877614:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578947456:0@lo:400:kworker.0 00000100:00100000:1.0:1789265445.877653:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265445.877691:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578947968:0@lo:400:kworker.0 00000100:00100000:1.0:1789265445.877718:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265445.877750:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578948480:0@lo:400:kworker.0 00000100:00100000:1.0:1789265445.877775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265445.877793:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578948992:0@lo:400:kworker.0 00000100:00100000:1.0:1789265445.877824:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265445.877846:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789265445.877852:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578947584:0@lo:400:kworker.0 00000100:00100000:1.0:1789265445.877896:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265445.878596:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578948096:0@lo:400:kworker.0 00000100:00100000:1.0:1789265445.878633:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265445.878662:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180578948608:0@lo:400:kworker.0 00000100:00100000:1.0:1789265445.878685:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265445.878724:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578947712 00000100:00100000:1.0:1789265445.878731:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578947712 00000100:00100000:1.0:1789265445.878783:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578947968 00000100:00100000:1.0:1789265445.878786:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578947968 00000100:00100000:1.0:1789265445.878802:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789265445.878809:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764355a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578947712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265445.878899:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764355a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578947712:12345-0@lo:400:kworker.0 Request processed in 89us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265445.878906:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789265445.879039:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578948480 00000100:00100000:0.0:1789265445.879043:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578948480 00000100:00100000:0.0:1789265445.879079:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578948992 00000100:00100000:0.0:1789265445.879082:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578948992 00000100:00100000:0.0:1789265445.879096:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789265445.879103:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578948480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265445.879146:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578948480:12345-0@lo:400:kworker.0 Request processed in 43us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265445.879163:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789265445.879177:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789265445.879182:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578948992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265445.879212:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578948992:12345-0@lo:400:kworker.0 Request processed in 29us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265445.879217:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789265445.879236:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789265445.879243:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e59c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578947968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265445.879272:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e59c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578947968:12345-0@lo:400:kworker.0 Request processed in 30us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265445.879279:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789265445.879415:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578947584 00000100:00100000:2.0:1789265445.879420:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578947584 00000100:00100000:2.0:1789265445.879448:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578948096 00000100:00100000:2.0:1789265445.879451:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578948096 00000100:00100000:2.0:1789265445.879463:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578948608 00000100:00100000:2.0:1789265445.879466:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578948608 00000100:00100000:2.0:1789265445.879480:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789265445.879486:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578947584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265445.879693:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578947456 00000100:00100000:3.0:1789265445.879698:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578947456 00000100:00100000:1.0:1789265445.880056:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789265445.880064:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578948096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265445.880111:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578948096:12345-0@lo:400:kworker.0 Request processed in 48us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265445.880117:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789265445.880131:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789265445.880137:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180578948608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265445.880163:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180578948608:12345-0@lo:400:kworker.0 Request processed in 27us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265445.880180:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789265445.880435:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578947584:12345-0@lo:400:kworker.0 Request processed in 947us (2536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265445.880442:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789265445.880594:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789265445.880604:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578947456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265445.880640:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578947456:12345-0@lo:400:kworker.0 Request processed in 38us (2986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265445.880646:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789265445.880806:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578947712:0@lo:400:kworker.0 00000100:00080000:0.0:1789265445.883156:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265445.883165:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265445.883167:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265445.883213:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578947584:0@lo:400:kworker.0 00000100:00100000:0.0:1789265445.883231:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578948096:0@lo:400:kworker.0 00000100:00100000:0.0:1789265445.883242:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180578948608:0@lo:400:kworker.0 00000100:00100000:0.0:1789265445.883253:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578947456:0@lo:400:kworker.0 00000100:00100000:0.0:1789265445.883263:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578947968:0@lo:400:kworker.0 00010000:00080000:0.0:1789265445.883277:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f385880 x1876180578948480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265445.883288:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578948480:0@lo:400:kworker.0 00010000:00080000:0.0:1789265445.883298:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f385f80 x1876180578948992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265445.883321:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578948992:0@lo:400:kworker.0 00000100:00100000:0.0:1789265446.387450:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764355b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578949120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265446.387524:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265446.387615:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578949120 00000100:00100000:0.0:1789265446.387621:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578949120 00000100:00100000:0.0:1789265446.387656:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789265446.387663:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578949120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265446.387690:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265446.387725:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578949120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265446.387730:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789265446.387748:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578949248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265446.387764:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265446.387782:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578949248 00000100:00100000:0.0:1789265446.387784:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578949248 00000100:00100000:0.0:1789265446.387795:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789265446.387798:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578949248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265446.387805:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265446.387822:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578949248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 24us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265446.387826:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1789265446.387846:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643cae680 x1876180578949248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265446.387873:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578949248:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789265446.387905:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764355b100 x1876180578949120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265446.387931:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764355b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578949120:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789265446.450985:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265446.661153:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265446.661210:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265446.661246:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265446.661278:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556851456 00000100:00100000:3.0:1789265446.661288:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556851456 00000100:00100000:3.0:1789265446.661350:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556851584 00000100:00100000:3.0:1789265446.661354:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556851584 00000100:00100000:3.0:1789265446.661380:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 125 00000100:00100000:3.0:1789265446.661398:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2397:x1876180556851456:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265446.661494:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2397:x1876180556851456:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 98us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265446.661503:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 125 00000100:00100000:3.0:1789265446.661519:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 126 00000100:00100000:3.0:1789265446.661526:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556851584:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265446.661567:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556851584:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 41us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265446.661573:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 126 00000100:00080000:3.0:1789265446.661592:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265446.661597:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265446.661780:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556851328 00000100:00100000:2.0:1789265446.661786:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556851328 00000100:00100000:2.0:1789265446.661824:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 290 00000100:00100000:2.0:1789265446.661838:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+10:2397:x1876180556851328:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265446.661894:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+10:2397:x1876180556851328:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 56us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265446.661901:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 290 00000100:00100000:1.0:1789265447.413726:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265447.413750:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578949376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265447.413853:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265447.414017:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578949376 00000100:00100000:1.0:1789265447.414025:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578949376 00000100:00100000:1.0:1789265447.414068:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789265447.414077:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578949376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265447.414109:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265447.414153:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578949376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265447.414159:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789265447.414204:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578949376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265447.416326:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265447.416349:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578949504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265447.416422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265447.416495:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578949504 00000100:00100000:0.0:1789265447.416501:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578949504 00000100:00100000:0.0:1789265447.416542:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789265447.416552:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578949504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265447.416585:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789265447.416648:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578949504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265447.416655:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789265447.416698:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578949504:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789265447.481979:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265447.925052:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578949632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265447.925144:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265447.925226:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578949632 00000100:00100000:3.0:1789265447.925233:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578949632 00000100:00100000:3.0:1789265447.925285:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789265447.925296:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643559c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578949632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265447.925325:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265447.925370:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643559c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578949632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265447.925377:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1789265447.925396:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265447.925425:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643558e00 x1876180578949632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265447.925443:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578949632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265447.928670:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578949760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265447.928742:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265447.928802:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578949760 00000100:00100000:3.0:1789265447.928811:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578949760 00000100:00100000:3.0:1789265447.928873:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789265447.928882:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578949760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265447.928924:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265447.928970:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578949760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265447.928977:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1789265447.928998:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265447.929030:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643558e00 x1876180578949760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265447.929051:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578949760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265448.499144:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265449.524322:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265450.547015:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265450.995219:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578949888:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.995294:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265450.995362:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578950400:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.995401:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265450.995424:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578950912:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.995447:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265450.995505:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578951424:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.995524:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265450.995545:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789265450.995550:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578950272:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.995599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265450.995617:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578950784:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.995636:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265450.995651:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578951296:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.995670:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265450.995698:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578950144:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.995738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265450.995755:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180578950656:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.995772:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265450.995785:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180578951168:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.995799:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265450.995826:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789265450.995832:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180578950016:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.995851:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265450.995898:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180578950528:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.995917:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265450.995925:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876180578951040:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.995940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265450.995960:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578950400 00000100:00100000:3.0:1789265450.995967:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578950400 00000100:00100000:3.0:1789265450.996006:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578950144 00000100:00100000:3.0:1789265450.996008:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578950144 00000100:00100000:3.0:1789265450.996022:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789265450.996043:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578950400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996095:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578950400:12345-0@lo:400:kworker.0 Request processed in 53us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265450.996102:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789265450.996120:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789265450.996126:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578950144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996156:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578950144:12345-0@lo:400:kworker.0 Request processed in 30us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265450.996172:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789265450.996191:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578950912 00000100:00100000:3.0:1789265450.996195:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578950912 00000100:00100000:3.0:1789265450.996222:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578951424 00000100:00100000:3.0:1789265450.996225:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578951424 00000100:00100000:3.0:1789265450.996237:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578950784 00000100:00100000:3.0:1789265450.996239:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578950784 00000100:00100000:3.0:1789265450.996248:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578951296 00000100:00100000:3.0:1789265450.996250:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578951296 00000100:00100000:3.0:1789265450.996261:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789265450.996266:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578950912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996298:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578950912:12345-0@lo:400:kworker.0 Request processed in 31us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265450.996304:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789265450.996316:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789265450.996322:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578951424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996347:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578951424:12345-0@lo:400:kworker.0 Request processed in 26us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265450.996352:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789265450.996362:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265450.996367:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578950784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996387:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578950784:12345-0@lo:400:kworker.0 Request processed in 21us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265450.996392:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265450.996401:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789265450.996406:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578951296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996438:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578951296:12345-0@lo:400:kworker.0 Request processed in 32us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265450.996443:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789265450.996460:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578950272 00000100:00100000:3.0:1789265450.996463:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578950272 00000100:00100000:3.0:1789265450.996479:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578950656 00000100:00100000:3.0:1789265450.996481:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578950656 00000100:00100000:3.0:1789265450.996491:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578951168 00000100:00100000:3.0:1789265450.996493:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578951168 00000100:00100000:3.0:1789265450.996501:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578950016 00000100:00100000:3.0:1789265450.996503:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578950016 00000100:00100000:3.0:1789265450.996511:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578950528 00000100:00100000:3.0:1789265450.996513:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578950528 00000100:00100000:3.0:1789265450.996522:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578951040 00000100:00100000:3.0:1789265450.996524:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578951040 00000100:00100000:3.0:1789265450.996535:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789265450.996540:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578950272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996564:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578950272:12345-0@lo:400:kworker.0 Request processed in 25us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265450.996570:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789265450.996579:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789265450.996584:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764355b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180578950656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996604:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764355b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180578950656:12345-0@lo:400:kworker.0 Request processed in 20us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265450.996609:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789265450.996617:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789265450.996622:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764355a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180578951168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996640:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764355a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180578951168:12345-0@lo:400:kworker.0 Request processed in 19us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265450.996651:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789265450.996662:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789265450.996666:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180578950016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996688:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180578950016:12345-0@lo:400:kworker.0 Request processed in 22us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265450.996693:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789265450.996701:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789265450.996705:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180578950528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996723:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180578950528:12345-0@lo:400:kworker.0 Request processed in 17us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265450.996727:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789265450.996736:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789265450.996741:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876180578951040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996758:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876180578951040:12345-0@lo:400:kworker.0 Request processed in 18us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265450.996763:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1789265450.996795:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265450.996798:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265450.996800:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265450.996802:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265450.996955:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180578950016:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996966:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180578950528:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996974:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876180578951040:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.996983:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578950144:0@lo:400:kworker.0 00010000:00080000:3.0:1789265450.997022:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e6fc700 x1876180578950656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265450.997033:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180578950656:0@lo:400:kworker.0 00010000:00080000:3.0:1789265450.997043:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e6ff800 x1876180578951168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265450.997050:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180578951168:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.997086:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578950272:0@lo:400:kworker.0 00010000:00080000:3.0:1789265450.997097:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e6fc000 x1876180578950784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265450.997105:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578950784:0@lo:400:kworker.0 00010000:00080000:3.0:1789265450.997115:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e6fe680 x1876180578951296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265450.997122:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578951296:0@lo:400:kworker.0 00000100:00100000:3.0:1789265450.997132:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578950400:0@lo:400:kworker.0 00010000:00080000:3.0:1789265450.997141:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e6fd500 x1876180578950912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265450.997148:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578950912:0@lo:400:kworker.0 00010000:00080000:3.0:1789265450.997158:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e40c380 x1876180578951424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265450.997165:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578951424:0@lo:400:kworker.0 00000100:00100000:0.0:1789265450.997418:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578949888 00000100:00100000:0.0:1789265450.997423:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578949888 00000100:00100000:0.0:1789265450.997470:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789265450.997478:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578949888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265450.997531:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578949888:12345-0@lo:400:kworker.0 Request processed in 54us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265450.997538:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789265451.004318:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578949888:0@lo:400:kworker.0 00000100:00100000:0.0:1789265451.507169:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578951552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265451.507288:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265451.507397:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578951552 00000100:00100000:0.0:1789265451.507405:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578951552 00000100:00100000:0.0:1789265451.507453:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789265451.507462:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578951552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265451.507503:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265451.507546:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578951552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265451.507553:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1789265451.507592:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e40df80 x1876180578951552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265451.507611:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578951552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265451.512041:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578951680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265451.512107:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265451.512224:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578951680 00000100:00100000:3.0:1789265451.512230:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578951680 00000100:00100000:3.0:1789265451.512282:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789265451.512291:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578951680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265451.512314:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265451.512355:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578951680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265451.512362:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1789265451.512403:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f386d80 x1876180578951680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265451.512420:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578951680:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789265451.572125:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265451.776605:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265451.776633:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265451.776652:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265451.776676:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556851712 00000100:00100000:3.0:1789265451.776694:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556851712 00000100:00100000:3.0:1789265451.776758:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 292 00000100:00100000:3.0:1789265451.776769:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+10:2397:x1876180556851712:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265451.776851:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+10:2397:x1876180556851712:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265451.776892:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 292 00000100:00100000:3.0:1789265451.776926:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556851968 00000100:00100000:3.0:1789265451.776930:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556851968 00000100:00100000:3.0:1789265451.776976:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556851840 00000100:00100000:3.0:1789265451.776980:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556851840 00000100:00100000:3.0:1789265451.776996:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 133 00000100:00100000:3.0:1789265451.777002:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556851968:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265451.777032:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556851968:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265451.777038:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 133 00000100:00100000:3.0:1789265451.777048:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 134 00000100:00100000:3.0:1789265451.777053:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2397:x1876180556851840:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265451.777070:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2397:x1876180556851840:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 18us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265451.777076:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 134 00000100:00080000:3.0:1789265451.777189:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265451.777192:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265452.531375:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578951808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265452.531451:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265452.531527:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578951808 00000100:00100000:1.0:1789265452.531535:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578951808 00000100:00100000:1.0:1789265452.531582:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789265452.531591:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578951808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265452.531625:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265452.531670:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578951808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265452.533469:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578951808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265452.533497:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265452.533507:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578951936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265452.533573:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265452.533812:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789265452.533839:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578951936 00000100:00100000:1.0:1789265452.533844:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578951936 00000100:00100000:1.0:1789265452.534606:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789265452.534617:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578951936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265452.534655:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265452.537538:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578951936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2910us (3951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265452.537552:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789265452.542413:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578951936:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789265452.597711:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265453.044423:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578952064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265453.044512:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265453.044808:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578952064 00000100:00100000:3.0:1789265453.044817:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578952064 00000100:00100000:3.0:1789265453.044917:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789265453.044929:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578952064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265453.044978:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265453.045033:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578952064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265453.045041:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1789265453.045129:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f386680 x1876180578952064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265453.045147:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578952064:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789265453.045386:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265453.045518:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265453.045529:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578952192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265453.045561:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265453.045696:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578952192 00000100:00100000:3.0:1789265453.045701:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578952192 00000100:00100000:3.0:1789265453.045742:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265453.045764:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578952192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265453.045777:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265453.045825:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578952192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265453.045831:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789265453.046008:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265453.046070:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e40fb80 x1876180578952192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265453.046085:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578952192:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789265453.619827:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265454.644634:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265455.668380:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265455.797334:0:11994:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:10:55 (1789265455) === 00000100:00100000:0.0:1789265456.118349:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578952576:0@lo:400:kworker.0 00000100:00100000:0.0:1789265456.118419:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265456.118495:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578953088:0@lo:400:kworker.0 00000100:00100000:0.0:1789265456.118521:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265456.118542:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180578953600:0@lo:400:kworker.0 00000100:00100000:0.0:1789265456.118586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265456.118612:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789265456.118618:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578952704:0@lo:400:kworker.0 00000100:00100000:0.0:1789265456.118640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265456.118658:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578953216:0@lo:400:kworker.0 00000100:00100000:0.0:1789265456.118681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265456.118697:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578953728:0@lo:400:kworker.0 00000100:00100000:0.0:1789265456.118717:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265456.118754:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578953088 00000100:00100000:0.0:1789265456.118762:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578953088 00000100:00100000:0.0:1789265456.118832:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578953600 00000100:00100000:0.0:1789265456.118836:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578953600 00000100:00100000:0.0:1789265456.118879:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578952704 00000100:00100000:0.0:1789265456.118883:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578952704 00000100:00100000:0.0:1789265456.118900:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789265456.118908:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578953088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265456.118961:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578953088:12345-0@lo:400:kworker.0 Request processed in 53us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.118969:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789265456.118984:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789265456.118990:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180578953600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265456.119015:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180578953600:12345-0@lo:400:kworker.0 Request processed in 25us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.119020:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789265456.119030:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789265456.119035:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578952704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265456.119076:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578952704:12345-0@lo:400:kworker.0 Request processed in 42us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.119082:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1789265456.119105:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265456.119136:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578952704:0@lo:400:kworker.0 00010000:00080000:0.0:1789265456.119149:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435ee680 x1876180578953088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265456.119159:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578953088:0@lo:400:kworker.0 00010000:00080000:0.0:1789265456.119168:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f159180 x1876180578953600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265456.119191:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180578953600:0@lo:400:kworker.0 00000100:00100000:2.0:1789265456.120292:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578952448:0@lo:400:kworker.0 00000100:00100000:2.0:1789265456.120342:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265456.120379:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578952960:0@lo:400:kworker.0 00000100:00100000:2.0:1789265456.120401:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265456.120422:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578953472:0@lo:400:kworker.0 00000100:00100000:2.0:1789265456.120442:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265456.120471:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1789265456.120477:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578952320:0@lo:400:kworker.0 00000100:00100000:2.0:1789265456.120506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265456.120527:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578952832:0@lo:400:kworker.0 00000100:00100000:2.0:1789265456.120548:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265456.120573:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578953344:0@lo:400:kworker.0 00000100:00100000:2.0:1789265456.120595:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265456.120613:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578953856:0@lo:400:kworker.0 00000100:00100000:2.0:1789265456.120632:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265456.120664:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578952320 00000100:00100000:2.0:1789265456.120670:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578952320 00000100:00100000:2.0:1789265456.120706:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789265456.120724:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578952320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265456.120768:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578952320:12345-0@lo:400:kworker.0 Request processed in 45us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265456.120775:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789265456.120804:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578952448 00000100:00100000:2.0:1789265456.120808:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578952448 00000100:00100000:2.0:1789265456.121994:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578952960 00000100:00100000:2.0:1789265456.122003:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578952960 00000100:00100000:2.0:1789265456.122026:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578953472 00000100:00100000:2.0:1789265456.122029:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578953472 00000100:00100000:2.0:1789265456.122047:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789265456.122054:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578952448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265456.122108:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578952448:12345-0@lo:400:kworker.0 Request processed in 54us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265456.122114:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789265456.122128:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789265456.122134:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578952960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265456.122160:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578952960:12345-0@lo:400:kworker.0 Request processed in 26us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265456.122165:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789265456.122287:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578953216 00000100:00100000:3.0:1789265456.122292:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578953216 00000100:00100000:3.0:1789265456.122314:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578953728 00000100:00100000:3.0:1789265456.122317:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578953728 00000100:00100000:3.0:1789265456.122329:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578953344 00000100:00100000:3.0:1789265456.122332:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578953344 00000100:00100000:3.0:1789265456.122342:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578953856 00000100:00100000:3.0:1789265456.122344:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578953856 00000100:00100000:3.0:1789265456.122356:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265456.122362:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578953216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265456.122404:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578953216:12345-0@lo:400:kworker.0 Request processed in 41us (3722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265456.122410:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265456.122423:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265456.122428:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578953728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265456.122454:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578953728:12345-0@lo:400:kworker.0 Request processed in 26us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265456.122459:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265456.122469:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265456.122475:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578953344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265456.122502:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578953344:12345-0@lo:400:kworker.0 Request processed in 28us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265456.122518:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789265456.122529:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789265456.122535:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578953856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265456.122566:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578953856:12345-0@lo:400:kworker.0 Request processed in 31us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265456.122571:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1789265456.122617:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f158e00 x1876180578953216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265456.122632:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578953216:0@lo:400:kworker.0 00010000:00080000:3.0:1789265456.122645:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f15aa00 x1876180578953728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265456.122654:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578953728:0@lo:400:kworker.0 00000100:00100000:3.0:1789265456.122704:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789265456.122712:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578953472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265456.122743:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578953472:12345-0@lo:400:kworker.0 Request processed in 32us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265456.122749:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789265456.122780:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578952320:0@lo:400:kworker.0 00010000:00080000:3.0:1789265456.122792:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f158a80 x1876180578953344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265456.122801:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578953344:0@lo:400:kworker.0 00010000:00080000:3.0:1789265456.122811:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f159f80 x1876180578953856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265456.122936:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578953856:0@lo:400:kworker.0 00000100:00100000:3.0:1789265456.122952:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578952448:0@lo:400:kworker.0 00000100:00100000:3.0:1789265456.122962:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578952960:0@lo:400:kworker.0 00000100:00100000:3.0:1789265456.122973:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578953472:0@lo:400:kworker.0 00000100:00080000:3.0:1789265456.123023:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265456.123027:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265456.123029:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265456.123110:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578952576 00000100:00100000:1.0:1789265456.123115:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578952576 00000100:00100000:1.0:1789265456.123148:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578952832 00000100:00100000:1.0:1789265456.123151:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578952832 00000100:00100000:1.0:1789265456.123165:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789265456.123181:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578952576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265456.123225:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578952576:12345-0@lo:400:kworker.0 Request processed in 54us (4806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265456.123237:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789265456.123250:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789265456.123255:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578952832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265456.123304:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578952832:12345-0@lo:400:kworker.0 Request processed in 48us (2755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265456.123311:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789265456.123343:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578952832:0@lo:400:kworker.0 00000100:00100000:1.0:1789265456.123365:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578952576:0@lo:400:kworker.0 00000100:00100000:3.0:1789265456.620435:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265456.620567:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556852096 00000100:00100000:0.0:1789265456.620579:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556852096 00000100:00100000:0.0:1789265456.620650:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 294 00000100:00100000:0.0:1789265456.620660:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:8734:x1876180556852096:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789265456.620676:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265456.620694:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937642392800/0xbbfdc9019c1d3ae7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91906b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265456.620723:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642392800/0xbbfdc9019c1d3ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91906b expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265456.620734:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937642392800/0xbbfdc9019c1d3ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91906b expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265456.620760:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392800, rc 0) 00000100:00100000:0.0:1789265456.620830:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+11:8734:x1876180556852096:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 171us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.620837:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 294 00000100:00100000:3.0:1789265456.626101:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265456.626346:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556852224 00000100:00100000:0.0:1789265456.626357:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556852224 00000100:00100000:0.0:1789265456.626419:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 295 00000100:00100000:0.0:1789265456.626430:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+11:8734:x1876180556852224:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789265456.626606:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+11:8734:x1876180556852224:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 177us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.626614:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 295 00000100:00100000:1.0:1789265456.627757:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265456.627780:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578953984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265456.627849:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265456.627851:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265456.627881:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f29ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578954112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265456.627915:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265456.627948:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578953984 00000100:00100000:1.0:1789265456.627955:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578953984 00000100:00100000:1.0:1789265456.627987:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578954112 00000100:00100000:1.0:1789265456.627990:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578954112 00000100:00100000:3.0:1789265456.628011:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789265456.628078:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578953984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265456.628108:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265456.628159:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578953984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (308us total) trans 0 rc 0/0 00010000:00080000:0.0:1789265456.628219:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e40d880 x1876180578953984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265456.628236:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578953984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265456.639769:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789265456.639941:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789265456.639957:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578954112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265456.639984:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265456.640071:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578954112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (12156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265456.640078:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1789265456.640174:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f29ad80 x1876180578954112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265456.640194:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f29ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578954112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265456.640323:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265456.640390:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556852352 00000100:00100000:2.0:1789265456.640397:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556852352 00000100:00100000:2.0:1789265456.640442:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 296 00000100:00100000:2.0:1789265456.640449:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+11:8734:x1876180556852352:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789265456.640581:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+11:8734:x1876180556852352:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 131us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265456.640594:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 296 00000100:00100000:3.0:1789265456.654796:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265456.655220:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556852480 00000100:00100000:2.0:1789265456.655230:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556852480 00000100:00100000:2.0:1789265456.655295:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 297 00000100:00100000:2.0:1789265456.655306:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+11:8738:x1876180556852480:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265456.655474:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+11:8738:x1876180556852480:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 169us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265456.655483:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 297 00010000:00010000:1.0:1789265456.691797:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265456.704492:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265456.706099:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556852608 00000100:00100000:0.0:1789265456.706112:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556852608 00000100:00100000:0.0:1789265456.706183:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 298 00000100:00100000:0.0:1789265456.706195:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+11:8738:x1876180556852608:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265456.706357:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+11:8738:x1876180556852608:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 164us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.706366:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 298 00000100:00100000:3.0:1789265456.724763:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265456.725133:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556852736 00000100:00100000:0.0:1789265456.725159:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556852736 00000100:00100000:0.0:1789265456.725222:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 299 00000100:00100000:0.0:1789265456.725233:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+11:8738:x1876180556852736:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265456.725378:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+11:8738:x1876180556852736:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 146us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.725385:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 299 00000100:00100000:3.0:1789265456.731725:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265456.732165:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556852864 00000100:00100000:0.0:1789265456.732176:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556852864 00000100:00100000:0.0:1789265456.732290:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 300 00000100:00100000:0.0:1789265456.732301:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+11:8734:x1876180556852864:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789265456.732317:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265456.732336:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937642392200/0xbbfdc9019c1d3aee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91909c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265456.732364:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642392200/0xbbfdc9019c1d3aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91909c expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265456.732375:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937642392200/0xbbfdc9019c1d3aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91909c expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265456.732384:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392200, rc 0) 00000100:00100000:0.0:1789265456.732444:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+12:8734:x1876180556852864:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 145us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.732451:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 300 00000100:00100000:3.0:1789265456.746241:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265456.746413:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556852992 00000100:00100000:2.0:1789265456.746423:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556852992 00000100:00100000:2.0:1789265456.746484:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 301 00000100:00100000:2.0:1789265456.746494:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+12:8734:x1876180556852992:12345-192.168.202.42@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789265456.746520:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789265456.746543:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789265456.746547:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789265456.746550:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789265456.746554:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789265456.746556:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1789265456.748483:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+12:8734:x1876180556852992:12345-192.168.202.42@tcp:256:mount.lustre.0 Request processed in 1984us (2243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265456.748506:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 301 00000100:00100000:3.0:1789265456.755146:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265456.755680:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556853120 00000100:00100000:0.0:1789265456.755691:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556853120 00000100:00100000:0.0:1789265456.755751:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 302 00000100:00100000:0.0:1789265456.755762:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+12:8734:x1876180556853120:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789265456.755790:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265456.755808:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3af5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9190a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265456.755851:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3af5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190a3 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265456.755905:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3af5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190a3 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265456.755915:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393200, rc 0) 00000100:00100000:0.0:1789265456.755981:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:8734:x1876180556853120:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 221us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.756260:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 302 00000100:00100000:3.0:1789265456.760227:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265456.760327:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556853248 00000100:00100000:2.0:1789265456.760337:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556853248 00000100:00100000:2.0:1789265456.760392:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 303 00000100:00100000:2.0:1789265456.760402:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:8734:x1876180556853248:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789265456.760562:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:8734:x1876180556853248:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 162us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265456.760578:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 303 00000100:00100000:3.0:1789265456.764303:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265456.764413:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556853376 00000100:00100000:2.0:1789265456.764424:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556853376 00000100:00100000:2.0:1789265456.764483:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 304 00000100:00100000:2.0:1789265456.764493:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:8734:x1876180556853376:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789265456.764927:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:8734:x1876180556853376:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 434us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265456.764937:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 304 00000100:00100000:3.0:1789265456.769457:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265456.769579:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556853504 00000100:00100000:0.0:1789265456.769589:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556853504 00000100:00100000:0.0:1789265456.769652:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 305 00000100:00100000:0.0:1789265456.769663:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:8742:x1876180556853504:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265456.769837:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:8742:x1876180556853504:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 175us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.769846:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 305 00000100:00100000:3.0:1789265456.774989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265456.775437:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556853632 00000100:00100000:2.0:1789265456.775447:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556853632 00000100:00100000:2.0:1789265456.775508:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 306 00000100:00100000:2.0:1789265456.775519:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:8742:x1876180556853632:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265456.775697:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:8742:x1876180556853632:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 179us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265456.775704:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 306 00000100:00100000:3.0:1789265456.794486:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265456.794529:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265456.794561:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265456.794674:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556853760 00000100:00100000:0.0:1789265456.794684:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556853760 00000100:00100000:0.0:1789265456.794731:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556854016 00000100:00100000:0.0:1789265456.794734:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556854016 00000100:00100000:0.0:1789265456.794756:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:0.0:1789265456.794764:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876180556853760:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789265456.794842:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 100bb9bf-f94c-48f4-a13a-604931ad9e86@192.168.202.42@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:0.0:1789265456.794907:0:6519:0:(genops.c:1385:class_connect()) connect: client 100bb9bf-f94c-48f4-a13a-604931ad9e86, cookie 0xbbfdc9019c1d3afc 00000004:00100000:0.0:1789265456.794934:0:6519:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1789265456.795068:0:6519:0:(import.c:65:import_set_state_nolock()) ffff937643350000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265456.795138:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2396:x1876180556853760:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 372us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.795146:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:0.0:1789265456.795164:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:0.0:1789265456.795168:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876180556854016:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789265456.795182:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 100bb9bf-f94c-48f4-a13a-604931ad9e86@192.168.202.42@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:0.0:1789265456.795205:0:6519:0:(genops.c:1385:class_connect()) connect: client 100bb9bf-f94c-48f4-a13a-604931ad9e86, cookie 0xbbfdc9019c1d3b03 00000004:00100000:0.0:1789265456.795216:0:6519:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1789265456.795267:0:6519:0:(import.c:65:import_set_state_nolock()) ffff937643351000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265456.795293:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2396:x1876180556854016:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 122us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.795299:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:2.0:1789265456.796190:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556854400 00000100:00100000:2.0:1789265456.796197:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556854400 00000100:00100000:2.0:1789265456.796263:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 141 00000100:00100000:2.0:1789265456.796271:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2399:x1876180556854400:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265456.796315:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2399:x1876180556854400:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 45us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265456.796323:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 141 00000100:00080000:3.0:1789265456.796890:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265456.802985:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265456.805450:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556854528 00000100:00100000:2.0:1789265456.805466:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556854528 00000100:00100000:2.0:1789265456.805569:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 142 00000100:00100000:2.0:1789265456.805581:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556854528:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265456.805681:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556854528:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 102us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265456.805688:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 142 00000100:00080000:3.0:1789265456.806893:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265456.809413:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265456.809521:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556853888 00000100:00100000:1.0:1789265456.809532:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556853888 00000100:00100000:1.0:1789265456.809615:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:1.0:1789265456.809626:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:0:x1876180556853888:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789265456.809675:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265456.809773:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:0:x1876180556853888:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 148us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265456.809780:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00080000:3.0:1789265456.810190:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265456.826090:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265456.826187:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265456.830498:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556854144 00000100:00100000:0.0:1789265456.830514:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556854144 00000100:00080000:3.0:1789265456.830719:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265456.830773:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556854272 00000100:00100000:0.0:1789265456.830778:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556854272 00000100:00100000:1.0:1789265456.830921:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:1.0:1789265456.830948:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:0:x1876180556854144:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789265456.831016:0:9988:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265456.831106:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:0:x1876180556854144:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 160us (5024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265456.831113:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:1.0:1789265456.831133:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:1.0:1789265456.831140:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:8734:x1876180556854272:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789265456.831152:0:9988:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265456.831177:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:8734:x1876180556854272:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 38us (4991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265456.831184:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:2.0:1789265456.834165:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265456.834258:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556854656 00000100:00100000:0.0:1789265456.834269:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556854656 00000100:00100000:0.0:1789265456.834328:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:0.0:1789265456.834340:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:8734:x1876180556854656:12345-192.168.202.42@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789265456.834433:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:8734:x1876180556854656:12345-192.168.202.42@tcp:40:mount.lustre.0 Request processed in 95us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.834457:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:2.0:1789265456.837592:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265456.837629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265456.837669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265456.837785:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556855040 00000100:00100000:1.0:1789265456.837795:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556855040 00000100:00100000:1.0:1789265456.837899:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:1.0:1789265456.837909:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:8734:x1876180556855040:12345-192.168.202.42@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789265456.838004:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:8734:x1876180556855040:12345-192.168.202.42@tcp:900:mount.lustre.0 Request processed in 96us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265456.838012:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:0.0:1789265456.838406:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556854784 00000100:00100000:0.0:1789265456.838412:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556854784 00000100:00100000:0.0:1789265456.838440:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556854912 00000100:00100000:0.0:1789265456.838443:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556854912 00000100:00100000:0.0:1789265456.838458:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:0.0:1789265456.838464:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1876180556854784:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789265456.838487:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 100bb9bf-f94c-48f4-a13a-604931ad9e86@192.168.202.42@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:0.0:1789265456.838514:0:8436:0:(genops.c:1385:class_connect()) connect: client 100bb9bf-f94c-48f4-a13a-604931ad9e86, cookie 0xbbfdc9019c1d3b0a 00002000:00100000:0.0:1789265456.838524:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 100bb9bf-f94c-48f4-a13a-604931ad9e86/ffff937643356800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789265456.838541:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789265456.838612:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789265456.838636:0:8436:0:(import.c:65:import_set_state_nolock()) ffff937643353800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265456.838668:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2396:x1876180556854784:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 203us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.838675:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:0.0:1789265456.838688:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:0.0:1789265456.838691:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f29b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1876180556854912:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789265456.838705:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 100bb9bf-f94c-48f4-a13a-604931ad9e86@192.168.202.42@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:0.0:1789265456.838722:0:8436:0:(genops.c:1385:class_connect()) connect: client 100bb9bf-f94c-48f4-a13a-604931ad9e86, cookie 0xbbfdc9019c1d3b11 00002000:00100000:0.0:1789265456.838726:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 100bb9bf-f94c-48f4-a13a-604931ad9e86/ffff937643357800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789265456.838732:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789265456.838766:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789265456.838779:0:8436:0:(import.c:65:import_set_state_nolock()) ffff937643352000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265456.842602:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f29b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2396:x1876180556854912:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 3893us (4917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265456.842618:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:2.0:1789265456.845336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265456.845831:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556855168 00000100:00100000:3.0:1789265456.845842:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556855168 00000100:00100000:3.0:1789265456.845923:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:3.0:1789265456.845933:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:8734:x1876180556855168:12345-192.168.202.42@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789265456.846036:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789265456.846127:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:8734:x1876180556855168:12345-192.168.202.42@tcp:33:mount.lustre.0 Request processed in 194us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265456.846135:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:3.0:1789265457.652063:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265457.652088:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578954240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265457.652160:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265457.652412:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265457.652423:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578954368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265457.652454:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265457.652723:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578954240 00000100:00100000:0.0:1789265457.652731:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578954240 00000100:00100000:2.0:1789265457.652750:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578954368 00000100:00100000:2.0:1789265457.652754:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578954368 00000100:00100000:0.0:1789265457.652775:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789265457.652782:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789265457.652784:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578954240:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265457.652788:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578954368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265457.652822:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000004:00000024:0.0:1789265457.652822:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789265457.652886:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578954240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265457.652887:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578954368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265457.652894:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789265457.652909:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789265457.652956:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578954368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265457.653322:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578954240:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789265457.716266:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265458.163479:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265458.163505:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578954624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265458.163578:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265458.163734:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578954624 00000100:00100000:1.0:1789265458.163742:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578954624 00000100:00100000:1.0:1789265458.163818:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789265458.163830:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578954624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265458.163884:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265458.163933:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578954624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265458.163941:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1789265458.163979:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e40c380 x1876180578954624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265458.163999:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578954624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265458.164019:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265458.164028:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578954496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265458.164056:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265458.164084:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578954496 00000100:00100000:1.0:1789265458.164088:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578954496 00000100:00100000:1.0:1789265458.164118:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789265458.164125:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578954496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265458.164134:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265458.164164:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578954496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265458.164169:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1789265458.164191:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f385500 x1876180578954496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265458.164203:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578954496:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789265458.164265:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789265458.739122:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265459.763979:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265460.801996:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265461.237689:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578955136:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.237789:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265461.237846:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578955648:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.237890:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265461.237908:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578956160:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.237931:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265461.237962:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789265461.237968:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578954752:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.237998:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265461.238020:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578955264:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238044:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265461.238062:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578955776:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238083:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265461.238098:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578956288:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238118:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265461.238144:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578954880:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238165:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265461.238178:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180578955392:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238194:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265461.238205:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180578955904:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238219:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265461.238244:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789265461.238249:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578955008:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238269:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265461.238284:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578955520:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238315:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265461.238326:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578956032:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238341:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265461.238366:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578955136 00000100:00100000:1.0:1789265461.238373:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578955136 00000100:00100000:1.0:1789265461.238407:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578954880 00000100:00100000:1.0:1789265461.238410:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578954880 00000100:00100000:1.0:1789265461.238419:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578955392 00000100:00100000:1.0:1789265461.238421:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578955392 00000100:00100000:1.0:1789265461.238440:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578955904 00000100:00100000:1.0:1789265461.238443:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578955904 00000100:00100000:1.0:1789265461.238469:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578955520 00000100:00100000:1.0:1789265461.238472:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578955520 00000100:00100000:1.0:1789265461.238485:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578956032 00000100:00100000:1.0:1789265461.238487:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578956032 00000100:00100000:1.0:1789265461.238502:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789265461.238509:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578955136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238559:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578955136:12345-0@lo:400:kworker.0 Request processed in 50us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265461.238567:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789265461.238584:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789265461.238590:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578954880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238620:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578954880:12345-0@lo:400:kworker.0 Request processed in 30us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265461.238625:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789265461.238637:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789265461.238643:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180578955392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238667:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180578955392:12345-0@lo:400:kworker.0 Request processed in 25us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265461.238678:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789265461.238689:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789265461.238695:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180578955904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238719:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180578955904:12345-0@lo:400:kworker.0 Request processed in 24us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265461.238724:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789265461.238735:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789265461.238741:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578955520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238767:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578955520:12345-0@lo:400:kworker.0 Request processed in 26us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265461.238786:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789265461.238798:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789265461.238803:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578956032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238828:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578956032:12345-0@lo:400:kworker.0 Request processed in 26us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265461.238834:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789265461.238852:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578955648 00000100:00100000:1.0:1789265461.238855:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578955648 00000100:00100000:1.0:1789265461.238893:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578956160 00000100:00100000:1.0:1789265461.238896:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578956160 00000100:00100000:1.0:1789265461.238906:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578955776 00000100:00100000:1.0:1789265461.238908:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578955776 00000100:00100000:1.0:1789265461.238918:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578956288 00000100:00100000:1.0:1789265461.238920:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578956288 00000100:00100000:1.0:1789265461.238931:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789265461.238937:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578955648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.238978:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578955648:12345-0@lo:400:kworker.0 Request processed in 41us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265461.238984:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789265461.238996:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789265461.239002:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578956160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.239028:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578956160:12345-0@lo:400:kworker.0 Request processed in 26us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265461.239033:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789265461.239044:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789265461.239048:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578955776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.239071:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578955776:12345-0@lo:400:kworker.0 Request processed in 23us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265461.239076:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789265461.239084:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265461.239089:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578956288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.239112:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578956288:12345-0@lo:400:kworker.0 Request processed in 23us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265461.239117:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265461.239135:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578954752 00000100:00100000:1.0:1789265461.239138:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578954752 00000100:00100000:1.0:1789265461.239164:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789265461.239170:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578954752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.239195:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578954752:12345-0@lo:400:kworker.0 Request processed in 26us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265461.239200:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789265461.239230:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578955264 00000100:00100000:1.0:1789265461.239234:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578955264 00000100:00100000:1.0:1789265461.239252:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578955008 00000100:00100000:1.0:1789265461.239254:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578955008 00000100:00100000:1.0:1789265461.239264:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789265461.239269:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578955264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.239296:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578955264:12345-0@lo:400:kworker.0 Request processed in 26us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265461.239301:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789265461.239310:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789265461.239315:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578955008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.239341:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578955008:12345-0@lo:400:kworker.0 Request processed in 25us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265461.239346:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1789265461.239370:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265461.239374:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265461.239377:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265461.239379:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265461.239411:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578955008:0@lo:400:kworker.0 00010000:00080000:1.0:1789265461.239425:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937779e56680 x1876180578955520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265461.239435:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578955520:0@lo:400:kworker.0 00010000:00080000:1.0:1789265461.239444:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937779e57800 x1876180578956032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265461.239453:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578956032:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.239462:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578954880:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.239480:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180578955392:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.239490:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180578955904:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.239529:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578954752:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.239539:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578955264:0@lo:400:kworker.0 00010000:00080000:1.0:1789265461.239548:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937779e54e00 x1876180578955776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265461.239557:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578955776:0@lo:400:kworker.0 00010000:00080000:1.0:1789265461.239566:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643586680 x1876180578956288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265461.239573:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578956288:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.239583:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578955136:0@lo:400:kworker.0 00010000:00080000:1.0:1789265461.239594:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937779e57480 x1876180578955648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265461.239601:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578955648:0@lo:400:kworker.0 00010000:00080000:1.0:1789265461.239610:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937779e57b80 x1876180578956160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265461.239617:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578956160:0@lo:400:kworker.0 00000100:00100000:1.0:1789265461.747161:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578956416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265461.747246:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265461.747381:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578956416 00000100:00100000:0.0:1789265461.747389:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578956416 00000100:00100000:0.0:1789265461.747441:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789265461.747450:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578956416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265461.747478:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265461.747542:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578956416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265461.747550:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1789265461.747905:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e40c380 x1876180578956416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265461.747938:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578956416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265461.748435:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265461.748447:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578956544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265461.748482:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265461.750222:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578956544 00000100:00100000:0.0:1789265461.750234:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578956544 00000100:00100000:0.0:1789265461.750291:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789265461.750300:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578956544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265461.750321:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265461.750421:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578956544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265461.750428:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1789265461.750692:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e40ed80 x1876180578956544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265461.750710:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578956544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789265461.811058:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265462.016110:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265462.016156:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265462.016187:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265462.016222:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265462.016240:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265462.016257:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265462.016284:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265462.016301:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556855296 00000100:00100000:2.0:1789265462.016304:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556855552 00000100:00100000:2.0:1789265462.016310:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556855552 00000100:00100000:0.0:1789265462.016310:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556855296 00000100:00100000:0.0:1789265462.016354:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 308 00000100:00100000:2.0:1789265462.016355:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556855808 00000100:00100000:2.0:1789265462.016358:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556855808 00000100:00100000:0.0:1789265462.016363:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556855296:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265462.016370:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556855424 00000100:00100000:2.0:1789265462.016372:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556855424 00000100:00100000:2.0:1789265462.016383:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556855680 00000100:00100000:2.0:1789265462.016385:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556855680 00000100:00100000:2.0:1789265462.016397:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 149 00000100:00100000:2.0:1789265462.016403:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556855552:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265462.016429:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556855552:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265462.016429:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556855296:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 67us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265462.016436:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 149 00000100:00100000:0.0:1789265462.016436:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 308 00000100:00100000:2.0:1789265462.016460:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 150 00000100:00100000:2.0:1789265462.016466:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2398:x1876180556855808:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265462.016466:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 151 00000100:00100000:0.0:1789265462.016472:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2398:x1876180556855424:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265462.016491:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2398:x1876180556855808:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265462.016491:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2398:x1876180556855424:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 18us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265462.016497:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 150 00000100:00100000:1.0:1789265462.016620:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556856064 00000100:00100000:1.0:1789265462.016624:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556856064 00000100:00100000:1.0:1789265462.016654:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556855936 00000100:00100000:1.0:1789265462.016657:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556855936 00000100:00100000:1.0:1789265462.016676:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 73 00000100:00100000:1.0:1789265462.016683:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2398:x1876180556856064:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265462.016713:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2398:x1876180556856064:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 32us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265462.016719:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 73 00000100:00100000:1.0:1789265462.016732:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 74 00000100:00100000:1.0:1789265462.016738:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2398:x1876180556855936:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265462.016760:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2398:x1876180556855936:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265462.016765:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 74 00000100:00080000:1.0:1789265462.016793:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265462.016796:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265462.016799:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265462.016800:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265462.017399:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 151 00000100:00100000:0.0:1789265462.017419:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 152 00000100:00100000:0.0:1789265462.017429:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2398:x1876180556855680:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265462.017462:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2398:x1876180556855680:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 35us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265462.017468:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 152 00000001:00100000:1.0:1789265462.262923:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 100bb9bf-f94c-48f4-a13a-604931ad9e86 00000001:00100000:0.0:1789265462.263042:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 100bb9bf-f94c-48f4-a13a-604931ad9e86 00000001:00100000:2.0:1789265462.270584:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 100bb9bf-f94c-48f4-a13a-604931ad9e86 00000001:00100000:3.0:1789265462.271751:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 100bb9bf-f94c-48f4-a13a-604931ad9e86 00000100:00100000:0.0:1789265462.782933:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578956672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265462.783100:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265462.783164:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265462.783172:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578956800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265462.783212:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265462.783249:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578956672 00000100:00100000:0.0:1789265462.783256:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578956672 00000100:00100000:0.0:1789265462.783297:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578956800 00000100:00100000:0.0:1789265462.783300:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578956800 00000100:00100000:0.0:1789265462.783318:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789265462.783327:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578956672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265462.783361:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789265462.783405:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578956672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265462.783412:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789265462.783429:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789265462.783435:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578956800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265462.783451:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265462.783478:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578956800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265462.783485:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789265462.783536:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578956800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265462.783549:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578956672:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789265462.837431:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265463.177735:0:12187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1789265463.283116:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578956928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265463.283199:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265463.283328:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578956928 00000100:00100000:1.0:1789265463.283346:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578956928 00000100:00100000:1.0:1789265463.283410:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789265463.283422:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578956928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265463.283453:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265463.283501:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578956928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265463.283509:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789265463.283657:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578957056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265463.283691:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265463.283723:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578957056 00000100:00100000:3.0:1789265463.283727:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578957056 00000100:00100000:3.0:1789265463.284035:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789265463.284044:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578957056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265463.284056:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265463.284091:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578957056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265463.284098:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1789265463.284171:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f386300 x1876180578957056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265463.284193:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578957056:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789265463.284349:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265463.284376:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643586300 x1876180578956928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265463.284391:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578956928:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789265463.859121:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265464.892774:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265465.907214:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265466.355299:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578957440:0@lo:400:kworker.0 00000100:00100000:3.0:1789265466.355369:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265466.355422:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578957952:0@lo:400:kworker.0 00000100:00100000:3.0:1789265466.355449:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265466.355464:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578958464:0@lo:400:kworker.0 00000100:00100000:3.0:1789265466.355483:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265466.355509:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789265466.355515:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578957568:0@lo:400:kworker.0 00000100:00100000:3.0:1789265466.355535:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265466.355573:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578958080:0@lo:400:kworker.0 00000100:00100000:3.0:1789265466.355599:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265466.355616:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578958592:0@lo:400:kworker.0 00000100:00100000:3.0:1789265466.355648:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265466.355686:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578957952 00000100:00100000:3.0:1789265466.355693:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578957952 00000100:00100000:3.0:1789265466.355756:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578958464 00000100:00100000:3.0:1789265466.355760:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578958464 00000100:00100000:3.0:1789265466.355776:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578957568 00000100:00100000:3.0:1789265466.355779:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578957568 00000100:00100000:3.0:1789265466.355794:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789265466.355802:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578957952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265466.355852:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578957952:12345-0@lo:400:kworker.0 Request processed in 51us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265466.355881:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789265466.355898:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789265466.355905:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578958464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265466.355932:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578958464:12345-0@lo:400:kworker.0 Request processed in 28us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265466.355938:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789265466.355950:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789265466.355957:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578957568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265466.355982:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578957568:12345-0@lo:400:kworker.0 Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265466.355987:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789265466.356009:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578958080 00000100:00100000:3.0:1789265466.356013:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578958080 00000100:00100000:3.0:1789265466.356039:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578958592 00000100:00100000:3.0:1789265466.356042:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578958592 00000100:00100000:3.0:1789265466.356059:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789265466.356065:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578958080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265466.356102:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578958080:12345-0@lo:400:kworker.0 Request processed in 37us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265466.356109:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789265466.356120:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789265466.356126:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578958592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265466.356151:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578958592:12345-0@lo:400:kworker.0 Request processed in 26us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265466.356156:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789265466.356175:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265466.356179:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265466.356181:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265466.356213:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578957568:0@lo:400:kworker.0 00010000:00080000:3.0:1789265466.356222:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e6fc000 x1876180578958080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265466.356229:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578958080:0@lo:400:kworker.0 00010000:00080000:3.0:1789265466.356234:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e6ff100 x1876180578958592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265466.356239:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578958592:0@lo:400:kworker.0 00010000:00080000:3.0:1789265466.356245:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e6fe680 x1876180578957952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265466.356249:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578957952:0@lo:400:kworker.0 00010000:00080000:3.0:1789265466.356254:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e6fc700 x1876180578958464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265466.356258:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578958464:0@lo:400:kworker.0 00000100:00100000:1.0:1789265466.356336:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578957184:0@lo:400:kworker.0 00000100:00100000:1.0:1789265466.356361:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265466.356385:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578957696:0@lo:400:kworker.0 00000100:00100000:1.0:1789265466.356400:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265466.356409:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578958208:0@lo:400:kworker.0 00000100:00100000:1.0:1789265466.356420:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265466.356427:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578958720:0@lo:400:kworker.0 00000100:00100000:1.0:1789265466.356438:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265466.356448:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789265466.356451:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578957312:0@lo:400:kworker.0 00000100:00100000:1.0:1789265466.356463:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265466.356469:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578957824:0@lo:400:kworker.0 00000100:00100000:1.0:1789265466.356480:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265466.356493:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180578958336:0@lo:400:kworker.0 00000100:00100000:1.0:1789265466.356505:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265466.356834:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578957440 00000100:00100000:0.0:1789265466.356839:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578957440 00000100:00100000:0.0:1789265466.356882:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578957696 00000100:00100000:0.0:1789265466.356885:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578957696 00000100:00100000:0.0:1789265466.356900:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789265466.356907:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578957440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265466.356951:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578957440:12345-0@lo:400:kworker.0 Request processed in 44us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265466.356964:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789265466.356978:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789265466.356983:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578957696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265466.357014:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578957696:12345-0@lo:400:kworker.0 Request processed in 31us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265466.357020:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789265466.357036:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578957312 00000100:00100000:0.0:1789265466.357040:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578957312 00000100:00100000:0.0:1789265466.357053:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578957824 00000100:00100000:0.0:1789265466.357056:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578957824 00000100:00100000:0.0:1789265466.357072:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578958336 00000100:00100000:0.0:1789265466.357075:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578958336 00000100:00100000:0.0:1789265466.357088:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789265466.357093:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578957312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265466.357118:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578957312:12345-0@lo:400:kworker.0 Request processed in 25us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265466.357124:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789265466.357134:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789265466.357139:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578957824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265466.357165:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578957824:12345-0@lo:400:kworker.0 Request processed in 25us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265466.357171:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789265466.357181:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789265466.357188:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180578958336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265466.357211:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180578958336:12345-0@lo:400:kworker.0 Request processed in 24us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265466.357226:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789265466.357243:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578958208 00000100:00100000:0.0:1789265466.357247:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578958208 00000100:00100000:0.0:1789265466.357265:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578958720 00000100:00100000:0.0:1789265466.357267:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578958720 00000100:00100000:0.0:1789265466.357278:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789265466.357284:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578958208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265466.357314:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578958208:12345-0@lo:400:kworker.0 Request processed in 30us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265466.357319:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789265466.357329:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789265466.357334:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578958720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265466.357358:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578958720:12345-0@lo:400:kworker.0 Request processed in 24us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265466.357363:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789265466.357927:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578957312:0@lo:400:kworker.0 00000100:00100000:1.0:1789265466.357940:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578957824:0@lo:400:kworker.0 00000100:00100000:1.0:1789265466.357949:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180578958336:0@lo:400:kworker.0 00000100:00100000:1.0:1789265466.357959:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578957696:0@lo:400:kworker.0 00010000:00080000:1.0:1789265466.357971:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e6fdc00 x1876180578958208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265466.357980:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578958208:0@lo:400:kworker.0 00010000:00080000:1.0:1789265466.357990:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e6fc380 x1876180578958720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265466.357998:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578958720:0@lo:400:kworker.0 00000100:00100000:3.0:1789265466.362355:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578957184 00000100:00100000:3.0:1789265466.362369:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578957184 00000100:00100000:3.0:1789265466.362427:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789265466.362436:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578957184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265466.362527:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578957184:12345-0@lo:400:kworker.0 Request processed in 92us (6163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265466.362534:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789265466.363323:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578957184:0@lo:400:kworker.0 00000100:00080000:3.0:1789265466.363372:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265466.363378:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265466.363381:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265466.363410:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578957440:0@lo:400:kworker.0 00000100:00100000:2.0:1789265466.867085:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265466.867113:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578958848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265466.867185:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265466.867258:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578958848 00000100:00100000:2.0:1789265466.867266:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578958848 00000100:00100000:2.0:1789265466.867311:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789265466.867320:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578958848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265466.867350:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265466.867391:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578958848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265466.867398:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1789265466.867455:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f37fb80 x1876180578958848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265466.867474:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578958848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265466.867762:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265466.867772:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578958976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265466.867806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265466.868085:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578958976 00000100:00100000:2.0:1789265466.868090:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578958976 00000100:00100000:2.0:1789265466.868153:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789265466.868160:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578958976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265466.868171:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265466.868209:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578958976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265466.868216:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1789265466.868270:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e40df80 x1876180578958976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265466.868285:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578958976:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789265466.931161:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265467.135668:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265467.135701:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265467.135734:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265467.135767:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265467.135815:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265467.135842:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265467.135884:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556856320 00000100:00100000:1.0:1789265467.135894:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556856320 00000100:00100000:1.0:1789265467.135942:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556856576 00000100:00100000:1.0:1789265467.135945:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556856576 00000100:00100000:1.0:1789265467.135957:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556856448 00000100:00100000:1.0:1789265467.135959:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556856448 00000100:00100000:1.0:1789265467.135970:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556856704 00000100:00100000:1.0:1789265467.135973:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556856704 00000100:00100000:1.0:1789265467.135987:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 159 00000100:00100000:1.0:1789265467.135998:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556856320:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265467.136076:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556856320:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 80us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265467.136085:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 159 00000100:00100000:1.0:1789265467.136102:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 160 00000100:00100000:1.0:1789265467.136109:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556856576:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265467.136135:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556856576:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265467.136141:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 160 00000100:00100000:1.0:1789265467.136947:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 161 00000100:00100000:1.0:1789265467.136959:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556856448:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265467.137010:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556856448:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 55us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265467.137016:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 161 00000100:00100000:1.0:1789265467.137031:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 162 00000100:00100000:1.0:1789265467.137044:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556856704:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265467.137072:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556856704:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 29us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265467.137079:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 162 00000100:00100000:1.0:1789265467.137109:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556856832 00000100:00100000:1.0:1789265467.137114:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556856832 00000100:00100000:0.0:1789265467.138032:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556856192 00000100:00100000:0.0:1789265467.138040:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556856192 00000100:00100000:0.0:1789265467.138087:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 310 00000100:00100000:0.0:1789265467.138096:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:2400:x1876180556856192:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265467.138141:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:2400:x1876180556856192:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 47us (2374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265467.138148:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 310 00000100:00100000:1.0:1789265467.138439:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 79 00000100:00100000:1.0:1789265467.138451:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556856832:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265467.138481:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556856832:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 34us (2747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265467.138488:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 79 00000100:00080000:1.0:1789265467.138507:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265467.138512:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265467.138515:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265467.139563:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265467.139652:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556856960 00000100:00100000:1.0:1789265467.139660:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556856960 00000100:00100000:1.0:1789265467.139771:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 80 00000100:00100000:1.0:1789265467.139793:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556856960:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265467.139848:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556856960:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 70us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265467.139855:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 80 00000100:00080000:0.0:1789265467.142091:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265467.892939:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578959104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265467.893019:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265467.894979:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265467.895006:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578959232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265467.895078:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265467.895412:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578959104 00000100:00100000:2.0:1789265467.895422:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578959104 00000100:00100000:2.0:1789265467.895485:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578959232 00000100:00100000:2.0:1789265467.895489:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578959232 00000100:00100000:2.0:1789265467.895507:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789265467.895515:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578959104:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265467.895634:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789265467.895643:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578959232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265467.895668:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265467.895740:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578959232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265467.895748:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000004:00000024:2.0:1789265467.896213:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789265467.896256:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578959104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 740us (3236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265467.896263:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789265467.896528:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578959232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265467.896740:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578959104:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789265467.963510:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265468.404602:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578959360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265468.404671:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265468.404947:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578959360 00000100:00100000:0.0:1789265468.404956:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578959360 00000100:00100000:0.0:1789265468.405016:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789265468.405027:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578959360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265468.405054:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265468.405096:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578959360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265468.405102:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1789265468.405140:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265468.405387:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643558a80 x1876180578959360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265468.405406:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578959360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265468.405716:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578959488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265468.405749:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265468.405811:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578959488 00000100:00100000:0.0:1789265468.405815:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578959488 00000100:00100000:0.0:1789265468.405853:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789265468.405879:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578959488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265468.405891:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265468.405921:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578959488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265468.405927:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1789265468.405951:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643558a80 x1876180578959488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265468.405977:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578959488:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789265468.406094:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789265468.982106:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265470.006091:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265470.860273:0:12503:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265470.860801:0:12503:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789265471.028406:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265471.480215:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578960000:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.480302:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265471.480364:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578960512:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.480395:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265471.480415:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578961024:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.480440:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265471.480477:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789265471.480485:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578959616:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.481636:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265471.481779:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578959616 00000100:00100000:3.0:1789265471.481791:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578959616 00000100:00100000:3.0:1789265471.481853:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789265471.481879:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3643:x1876180578959616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265471.481941:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3643:x1876180578959616:12345-0@lo:400:kworker.0 Request processed in 80us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265471.481948:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789265471.482034:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578959616:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.482044:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578960128:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.482074:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265471.482104:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578960640:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.482128:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265471.482151:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764354d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578961152:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.482173:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265471.482215:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578959744:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.482242:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265471.482262:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578960256:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.482285:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265471.482301:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180578960768:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.482335:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265471.482356:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789265471.482363:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578959872:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.482383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265471.482403:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578960384:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.482424:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265471.482436:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180578960896:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.482455:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265471.482485:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578960000 00000100:00100000:0.0:1789265471.482488:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578960000 00000100:00100000:3.0:1789265471.482593:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578960128 00000100:00100000:3.0:1789265471.482597:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578960128 00000100:00100000:3.0:1789265471.482625:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578959872 00000100:00100000:3.0:1789265471.482635:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578959872 00000100:00100000:3.0:1789265471.482654:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789265471.482660:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578960128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265471.482718:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578960128:12345-0@lo:400:kworker.0 Request processed in 58us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265471.482726:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789265471.482739:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789265471.482745:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578959872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265471.482777:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578959872:12345-0@lo:400:kworker.0 Request processed in 32us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265471.482783:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789265471.482945:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578959744 00000100:00100000:0.0:1789265471.482949:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578959744 00000100:00100000:0.0:1789265471.482963:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578960256 00000100:00100000:0.0:1789265471.482966:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578960256 00000100:00100000:0.0:1789265471.484192:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578960768 00000100:00100000:0.0:1789265471.484199:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578960768 00000100:00080000:3.0:1789265471.489061:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265471.489207:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578960512 00000100:00100000:3.0:1789265471.489219:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578960512 00000100:00100000:3.0:1789265471.489279:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578961024 00000100:00100000:3.0:1789265471.489283:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578961024 00000100:00100000:3.0:1789265471.489298:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578960640 00000100:00100000:3.0:1789265471.489301:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578960640 00000100:00100000:3.0:1789265471.489312:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578961152 00000100:00100000:3.0:1789265471.489315:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578961152 00000100:00100000:3.0:1789265471.489334:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789265471.489343:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578960512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265471.489433:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578960512:12345-0@lo:400:kworker.0 Request processed in 91us (9037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265471.489441:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789265471.489458:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789265471.489463:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578961024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265471.489494:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578961024:12345-0@lo:400:kworker.0 Request processed in 31us (9053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265471.489519:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789265471.489531:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789265471.489537:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578960640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265471.489568:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578960640:12345-0@lo:400:kworker.0 Request processed in 31us (7440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265471.489574:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789265471.489585:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789265471.489591:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578961152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265471.489619:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578961152:12345-0@lo:400:kworker.0 Request processed in 28us (7444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265471.489625:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789265471.489802:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265471.489806:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265471.489915:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578960384 00000100:00100000:1.0:1789265471.489920:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578960384 00000100:00100000:1.0:1789265471.489958:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578960896 00000100:00100000:1.0:1789265471.489961:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578960896 00000100:00100000:1.0:1789265471.489977:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789265471.489985:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578960000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265471.490023:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578960000:12345-0@lo:400:kworker.0 Request processed in 39us (9722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265471.490029:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789265471.490044:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789265471.490051:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578959744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265471.490080:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578959744:12345-0@lo:400:kworker.0 Request processed in 30us (7837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265471.490086:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789265471.490099:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789265471.490106:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578960256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265471.490134:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578960256:12345-0@lo:400:kworker.0 Request processed in 29us (7849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265471.490140:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789265471.490152:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789265471.490158:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578960384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265471.490184:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578960384:12345-0@lo:400:kworker.0 Request processed in 26us (7759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265471.490190:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789265471.490202:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789265471.490216:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180578960896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265471.490245:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180578960896:12345-0@lo:400:kworker.0 Request processed in 31us (7789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265471.490250:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:3.0:1789265471.490313:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265471.490622:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789265471.490631:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180578960768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.490668:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180578960768:12345-0@lo:400:kworker.0 Request processed in 39us (8332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265471.490770:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789265471.490823:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578959872:0@lo:400:kworker.0 00010000:00080000:0.0:1789265471.490842:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435edf80 x1876180578960384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265471.490854:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578960384:0@lo:400:kworker.0 00010000:00080000:0.0:1789265471.490896:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435ee680 x1876180578960896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265471.490913:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180578960896:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.490928:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578959744:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.490939:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578960256:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.490950:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180578960768:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.490999:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578960128:0@lo:400:kworker.0 00010000:00080000:0.0:1789265471.491012:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435ed880 x1876180578960640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265471.491021:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578960640:0@lo:400:kworker.0 00010000:00080000:0.0:1789265471.491032:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764354d180 x1876180578961152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265471.491040:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764354d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578961152:0@lo:400:kworker.0 00000100:00100000:0.0:1789265471.491051:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578960000:0@lo:400:kworker.0 00010000:00080000:0.0:1789265471.491062:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435ec380 x1876180578960512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265471.491070:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578960512:0@lo:400:kworker.0 00010000:00080000:0.0:1789265471.491081:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435ed180 x1876180578961024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265471.491089:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578961024:0@lo:400:kworker.0 00000100:00100000:1.0:1789265471.987986:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265471.988010:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578961280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265471.988082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265471.988163:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578961280 00000100:00100000:1.0:1789265471.988170:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578961280 00000100:00100000:1.0:1789265471.988219:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789265471.988228:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578961280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265471.988259:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265471.988303:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578961280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265471.988311:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:1.0:1789265471.988597:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937779e55180 x1876180578961280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265471.988616:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578961280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265471.990337:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265471.990352:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578961408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265471.990399:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265471.990439:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578961408 00000100:00100000:1.0:1789265471.990445:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578961408 00000100:00100000:1.0:1789265471.990482:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789265471.990488:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578961408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265471.990505:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265471.990557:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578961408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265471.990564:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1789265471.990601:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937779e55180 x1876180578961408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265471.990616:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578961408:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265472.051216:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265472.254012:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265472.254052:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265472.254081:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265472.254119:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265472.254139:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265472.254160:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265472.254195:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265472.254223:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556857344 00000100:00100000:2.0:1789265472.254233:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556857344 00000100:00100000:2.0:1789265472.254301:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556857600 00000100:00100000:2.0:1789265472.254305:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556857600 00000100:00100000:2.0:1789265472.254321:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556857216 00000100:00100000:2.0:1789265472.254323:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556857216 00000100:00100000:2.0:1789265472.254335:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556857472 00000100:00100000:2.0:1789265472.254337:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556857472 00000100:00100000:2.0:1789265472.254353:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 169 00000100:00100000:2.0:1789265472.254364:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556857344:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265472.254469:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556857344:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 107us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265472.254477:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 169 00000100:00100000:2.0:1789265472.254494:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 170 00000100:00100000:2.0:1789265472.254501:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556857600:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265472.254545:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556857600:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 45us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265472.254552:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 170 00000100:00100000:2.0:1789265472.254565:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 171 00000100:00100000:2.0:1789265472.254572:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556857216:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265472.254597:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556857216:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265472.254603:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 171 00000100:00100000:2.0:1789265472.254615:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 172 00000100:00100000:2.0:1789265472.254621:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556857472:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265472.254643:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556857472:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265472.254649:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 172 00000100:00080000:1.0:1789265472.256779:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265472.256790:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265472.256966:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556857088 00000100:00100000:3.0:1789265472.256979:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556857088 00000100:00100000:3.0:1789265472.257068:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 312 00000100:00100000:3.0:1789265472.257079:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:2400:x1876180556857088:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265472.257167:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:2400:x1876180556857088:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 90us (3167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265472.257175:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 312 00000100:00100000:3.0:1789265472.257215:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556857856 00000100:00100000:3.0:1789265472.257220:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556857856 00000100:00100000:3.0:1789265472.257257:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556857728 00000100:00100000:3.0:1789265472.257260:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556857728 00000100:00100000:3.0:1789265472.257280:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 85 00000100:00100000:3.0:1789265472.257286:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556857856:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265472.257330:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556857856:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 44us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265472.257336:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 85 00000100:00100000:3.0:1789265472.257348:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 86 00000100:00100000:3.0:1789265472.257353:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556857728:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265472.257372:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556857728:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 19us (3178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265472.257378:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 86 00000100:00080000:3.0:1789265472.257396:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265472.257398:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000004:2.0:1789265472.736746:0:12601:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265472.736988:0:12601:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789265473.011335:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265473.011360:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578961536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265473.011432:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265473.011510:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578961536 00000100:00100000:1.0:1789265473.011518:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578961536 00000100:00100000:1.0:1789265473.011565:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789265473.011575:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578961536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265473.011608:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265473.011654:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578961536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265473.011679:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789265473.011730:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578961536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265473.020845:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578961664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265473.020954:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265473.021154:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578961664 00000100:00100000:0.0:1789265473.021163:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578961664 00000100:00100000:0.0:1789265473.021215:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789265473.021225:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578961664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265473.021261:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265473.021347:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578961664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265473.021355:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789265473.023656:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578961664:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789265473.092248:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265473.524251:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578961792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265473.524342:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265473.524565:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265473.524575:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578961920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265473.524602:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265473.524703:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578961792 00000100:00100000:1.0:1789265473.524712:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578961792 00000100:00100000:1.0:1789265473.524772:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578961920 00000100:00100000:1.0:1789265473.524775:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578961920 00000100:00100000:1.0:1789265473.524795:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789265473.524804:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578961792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265473.524835:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265473.524924:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578961792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265473.524932:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789265473.524949:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789265473.524956:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578961920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265473.524966:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1789265473.525007:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775285e680 x1876180578961792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265473.525020:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265473.525029:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578961792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265473.525668:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578961920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 700us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265473.525678:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1789265473.527912:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f15bb80 x1876180578961920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265473.527938:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578961920:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789265474.101924:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265474.926296:0:12698:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265474.926734:0:12698:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265475.135979:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265476.147016:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265476.595138:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578962176:0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.595225:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265476.595282:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578962688:0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.595306:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265476.595331:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578963200:0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.595353:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265476.595381:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1789265476.595387:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578962048:0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.595416:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265476.595439:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578962560:0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.595462:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265476.595481:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578963072:0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.595505:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265476.595522:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578963584:0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.595546:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265476.595611:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578962304:0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.595647:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265476.595667:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764354d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578962816:0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.595687:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265476.595702:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180578963328:0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.595724:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265476.595737:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789265476.595742:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578962432:0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.595761:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265476.595771:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578962944:0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.595788:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265476.595804:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578963456:0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.595822:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265476.597361:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578962176 00000100:00100000:0.0:1789265476.597378:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578962176 00000100:00100000:0.0:1789265476.597434:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578962688 00000100:00100000:0.0:1789265476.597438:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578962688 00000100:00100000:0.0:1789265476.597461:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578963200 00000100:00100000:0.0:1789265476.597464:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578963200 00000100:00100000:0.0:1789265476.597478:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578962816 00000100:00100000:0.0:1789265476.597480:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578962816 00000100:00100000:0.0:1789265476.597492:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578963328 00000100:00100000:0.0:1789265476.597494:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578963328 00000100:00100000:0.0:1789265476.597507:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578962432 00000100:00100000:0.0:1789265476.597510:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578962432 00000100:00100000:0.0:1789265476.597528:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789265476.597538:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578962176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.597628:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578962176:12345-0@lo:400:kworker.0 Request processed in 91us (2403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265476.597656:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789265476.597674:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789265476.597680:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578962688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.597710:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578962688:12345-0@lo:400:kworker.0 Request processed in 30us (2403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265476.597715:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789265476.597726:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789265476.597732:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578963200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.597757:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578963200:12345-0@lo:400:kworker.0 Request processed in 26us (2404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265476.597763:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789265476.597773:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789265476.597779:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578962816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.597809:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180578962816:12345-0@lo:400:kworker.0 Request processed in 30us (2121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265476.597815:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789265476.597827:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789265476.597833:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180578963328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.597878:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180578963328:12345-0@lo:400:kworker.0 Request processed in 45us (2152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265476.597883:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789265476.597893:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789265476.597898:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578962432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.597920:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578962432:12345-0@lo:400:kworker.0 Request processed in 23us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265476.597931:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789265476.597962:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578962048 00000100:00100000:0.0:1789265476.597967:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578962048 00000100:00100000:0.0:1789265476.597994:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789265476.598001:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578962048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.598031:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578962048:12345-0@lo:400:kworker.0 Request processed in 31us (2614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265476.598037:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789265476.598066:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578962560 00000100:00100000:0.0:1789265476.598069:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578962560 00000100:00100000:0.0:1789265476.598090:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578962304 00000100:00100000:0.0:1789265476.598092:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578962304 00000100:00100000:0.0:1789265476.598103:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789265476.598109:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578962560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.598139:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578962560:12345-0@lo:400:kworker.0 Request processed in 30us (2676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265476.598145:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789265476.598154:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789265476.598160:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578962304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265476.598185:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578962304:12345-0@lo:400:kworker.0 Request processed in 26us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265476.598191:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789265476.599398:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578963072 00000100:00100000:1.0:1789265476.599407:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578963072 00000100:00100000:1.0:1789265476.599443:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578963584 00000100:00100000:1.0:1789265476.599446:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578963584 00000100:00100000:1.0:1789265476.599458:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578962944 00000100:00100000:1.0:1789265476.599461:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578962944 00000100:00100000:1.0:1789265476.599472:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578963456 00000100:00100000:1.0:1789265476.599474:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578963456 00000100:00100000:1.0:1789265476.599490:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789265476.599498:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578963072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265476.599564:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578963072:12345-0@lo:400:kworker.0 Request processed in 67us (4058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265476.599571:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789265476.599588:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789265476.599593:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578963584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265476.599622:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578963584:12345-0@lo:400:kworker.0 Request processed in 29us (4075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265476.599652:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789265476.599664:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789265476.599671:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578962944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265476.599700:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578962944:12345-0@lo:400:kworker.0 Request processed in 30us (3911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265476.599706:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789265476.599714:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789265476.599721:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578963456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265476.599745:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578963456:12345-0@lo:400:kworker.0 Request processed in 26us (3923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265476.599750:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789265476.599830:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578962432:0@lo:400:kworker.0 00010000:00080000:1.0:1789265476.599845:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f298a80 x1876180578962944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265476.599855:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578962944:0@lo:400:kworker.0 00010000:00080000:1.0:1789265476.599933:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435ed880 x1876180578963456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265476.599942:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578963456:0@lo:400:kworker.0 00000100:00100000:1.0:1789265476.599955:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578962304:0@lo:400:kworker.0 00010000:00080000:1.0:1789265476.599966:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764354d180 x1876180578962816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265476.599972:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764354d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180578962816:0@lo:400:kworker.0 00010000:00080000:1.0:1789265476.599992:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435efb80 x1876180578963328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265476.600000:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180578963328:0@lo:400:kworker.0 00000100:00100000:1.0:1789265476.600043:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578962048:0@lo:400:kworker.0 00000100:00100000:1.0:1789265476.600054:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578962560:0@lo:400:kworker.0 00010000:00080000:1.0:1789265476.600064:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435ed180 x1876180578963072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265476.600071:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578963072:0@lo:400:kworker.0 00010000:00080000:1.0:1789265476.600081:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435eed80 x1876180578963584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265476.600088:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578963584:0@lo:400:kworker.0 00000100:00100000:1.0:1789265476.600099:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578962176:0@lo:400:kworker.0 00000100:00100000:1.0:1789265476.600110:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578962688:0@lo:400:kworker.0 00000100:00100000:1.0:1789265476.600120:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578963200:0@lo:400:kworker.0 00000100:00080000:2.0:1789265476.600383:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265476.600388:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265476.600391:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265476.600394:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265477.113385:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265477.113408:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578963840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265477.113471:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265477.113526:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578963840 00000100:00100000:0.0:1789265477.113538:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578963840 00000100:00100000:0.0:1789265477.113579:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789265477.113587:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578963840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265477.113618:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265477.113670:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578963840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265477.113676:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1789265477.113991:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36ce00 x1876180578963840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265477.114008:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578963840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265477.114996:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578963712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265477.115045:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265477.115139:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578963712 00000100:00100000:0.0:1789265477.115145:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578963712 00000100:00100000:0.0:1789265477.115212:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789265477.115221:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578963712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265477.115240:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265477.115282:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578963712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265477.115289:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1789265477.115486:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f158a80 x1876180578963712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265477.115502:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578963712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265477.172034:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789265477.206216:0:12795:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265477.206433:0:12795:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789265477.374934:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265477.374978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265477.375006:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265477.375027:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265477.375046:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265477.375070:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265477.375101:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265477.375147:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556858112 00000100:00100000:3.0:1789265477.375166:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556858112 00000100:00100000:3.0:1789265477.375222:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556858368 00000100:00100000:3.0:1789265477.375226:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556858368 00000100:00100000:3.0:1789265477.375241:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556858240 00000100:00100000:3.0:1789265477.375243:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556858240 00000100:00100000:3.0:1789265477.375256:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556858496 00000100:00100000:3.0:1789265477.375259:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556858496 00000100:00100000:3.0:1789265477.375287:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 179 00000100:00100000:3.0:1789265477.375298:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2398:x1876180556858112:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265477.375393:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2398:x1876180556858112:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 85us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265477.375402:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 179 00000100:00100000:3.0:1789265477.375420:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 180 00000100:00100000:3.0:1789265477.375428:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556858368:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265477.375454:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556858368:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265477.376231:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 180 00000100:00100000:3.0:1789265477.376251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 181 00000100:00100000:3.0:1789265477.376260:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556858240:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265477.376807:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556858240:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 544us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265477.376815:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 181 00000100:00100000:3.0:1789265477.376833:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 182 00000100:00100000:3.0:1789265477.376842:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556858496:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265477.376890:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556858496:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 50us (1843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265477.376904:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 182 00000100:00100000:3.0:1789265477.376939:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556857984 00000100:00100000:3.0:1789265477.376947:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556857984 00000100:00100000:3.0:1789265477.376992:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 314 00000100:00100000:3.0:1789265477.377000:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556857984:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265477.377029:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556857984:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 30us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265477.377035:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 314 00000100:00100000:3.0:1789265477.377255:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556858624 00000100:00100000:3.0:1789265477.377260:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556858624 00000100:00100000:3.0:1789265477.377380:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556858752 00000100:00100000:3.0:1789265477.377695:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556858752 00000100:00100000:3.0:1789265477.377729:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:3.0:1789265477.377739:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2396:x1876180556858624:12345-192.168.202.42@tcp:9:kworker.0 00000020:00000080:3.0:1789265477.377762:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3b0a 00000100:00080000:3.0:1789265477.377773:0:8436:0:(import.c:65:import_set_state_nolock()) ffff937643353800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265477.377828:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789265477.377985:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+2:2396:x1876180556858624:12345-192.168.202.42@tcp:9:kworker.0 Request processed in 247us (2912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265477.377992:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:3.0:1789265477.378006:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:3.0:1789265477.378013:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2396:x1876180556858752:12345-192.168.202.42@tcp:9:kworker.0 00000020:00000080:3.0:1789265477.378025:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3b11 00000100:00080000:3.0:1789265477.378030:0:8436:0:(import.c:65:import_set_state_nolock()) ffff937643352000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265477.379672:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789265477.379838:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+2:2396:x1876180556858752:12345-192.168.202.42@tcp:9:kworker.0 Request processed in 1820us (4731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265477.379848:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00080000:3.0:1789265477.379893:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265477.379898:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265477.379902:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265477.379905:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789265477.380856:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265477.380881:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265478.132117:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764241a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578963968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265478.132210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265478.132289:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578963968 00000100:00100000:2.0:1789265478.132297:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578963968 00000100:00100000:2.0:1789265478.132350:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789265478.132360:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578963968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265478.132394:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265478.132458:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578963968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265478.132467:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789265478.132512:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764241a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578963968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265478.139503:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578964096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265478.139599:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265478.140370:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578964096 00000100:00100000:1.0:1789265478.140379:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578964096 00000100:00100000:1.0:1789265478.140423:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789265478.140434:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578964096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265478.140547:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265478.140608:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578964096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 177us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265478.141554:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789265478.144023:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578964096:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789265478.196010:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265478.643047:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265478.643068:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578964224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265478.643131:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265478.643210:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578964224 00000100:00100000:3.0:1789265478.643219:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578964224 00000100:00100000:3.0:1789265478.643264:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789265478.643274:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578964224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265478.643305:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265478.643348:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578964224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265478.643353:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1789265478.643369:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265478.643389:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e6fdf80 x1876180578964224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265478.643404:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578964224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265478.643502:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265478.643513:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578964352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265478.643535:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265478.643554:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578964352 00000100:00100000:0.0:1789265478.643556:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578964352 00000100:00100000:0.0:1789265478.643588:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789265478.643593:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578964352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265478.643600:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265478.643654:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578964352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265478.643661:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789265478.643677:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265478.643693:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36ce00 x1876180578964352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265478.643706:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578964352:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265479.219179:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789265479.426546:0:12894:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265479.426790:0:12894:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789265480.243107:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265481.267214:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265481.721344:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578964736:0@lo:400:kworker.0 00000100:00100000:2.0:1789265481.721442:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265481.721510:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578965248:0@lo:400:kworker.0 00000100:00100000:2.0:1789265481.721540:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265481.721557:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180578965760:0@lo:400:kworker.0 00000100:00100000:2.0:1789265481.721579:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265481.721614:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789265481.721621:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578964608:0@lo:400:kworker.0 00000100:00100000:2.0:1789265481.721647:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265481.721662:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578965120:0@lo:400:kworker.0 00000100:00100000:2.0:1789265481.721683:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265481.721704:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578965632:0@lo:400:kworker.0 00000100:00100000:2.0:1789265481.721727:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265481.721762:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578964736 00000100:00100000:2.0:1789265481.721771:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578964736 00000100:00100000:2.0:1789265481.721829:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789265481.721839:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578964736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.721980:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578964480:0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.722031:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265481.722059:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578964992:0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.722082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265481.722101:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578965504:0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.722233:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265481.722255:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578966016:0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.722274:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265481.722290:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789265481.722295:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578964864:0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.722314:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265481.722322:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578965376:0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.722340:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265481.722353:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578965888:0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.722371:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265481.722400:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578965248 00000100:00100000:3.0:1789265481.722404:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578965248 00000100:00100000:3.0:1789265481.722441:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578965760 00000100:00100000:3.0:1789265481.722445:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578965760 00000100:00100000:3.0:1789265481.722457:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578964608 00000100:00100000:3.0:1789265481.722460:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578964608 00000100:00100000:3.0:1789265481.722468:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578965120 00000100:00100000:3.0:1789265481.722470:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578965120 00000100:00100000:3.0:1789265481.722480:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578965632 00000100:00100000:3.0:1789265481.722482:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578965632 00000100:00100000:3.0:1789265481.722491:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578964864 00000100:00100000:3.0:1789265481.722506:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578964864 00000100:00100000:3.0:1789265481.722520:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789265481.722526:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578965248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.722574:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578965248:12345-0@lo:400:kworker.0 Request processed in 48us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265481.722582:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789265481.722609:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789265481.722615:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180578965760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.722640:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180578965760:12345-0@lo:400:kworker.0 Request processed in 25us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265481.722646:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789265481.722656:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789265481.722661:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578964608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.722688:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578964608:12345-0@lo:400:kworker.0 Request processed in 27us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265481.722694:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789265481.722704:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789265481.722710:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578965120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.722734:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578965120:12345-0@lo:400:kworker.0 Request processed in 24us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265481.722740:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789265481.722751:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789265481.722756:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578965632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.722782:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578965632:12345-0@lo:400:kworker.0 Request processed in 26us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265481.722797:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789265481.722809:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789265481.722815:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578964864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.722847:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578964864:12345-0@lo:400:kworker.0 Request processed in 33us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265481.722853:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789265481.724305:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578964480 00000100:00100000:3.0:1789265481.724320:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578964480 00000100:00100000:3.0:1789265481.724365:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789265481.724373:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775011b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180578964480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.724452:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775011b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180578964480:12345-0@lo:400:kworker.0 Request processed in 80us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265481.724460:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789265481.724496:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578964992 00000100:00100000:3.0:1789265481.724501:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578964992 00000100:00100000:3.0:1789265481.724520:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789265481.724526:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578964992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.724560:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578964992:12345-0@lo:400:kworker.0 Request processed in 34us (2477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265481.724566:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789265481.724595:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578965504 00000100:00100000:3.0:1789265481.724599:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578965504 00000100:00100000:3.0:1789265481.724624:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578966016 00000100:00100000:3.0:1789265481.724627:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578966016 00000100:00100000:3.0:1789265481.724640:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578965376 00000100:00100000:3.0:1789265481.724642:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578965376 00000100:00100000:3.0:1789265481.724654:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578965888 00000100:00100000:3.0:1789265481.724667:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578965888 00000100:00100000:3.0:1789265481.724687:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789265481.724693:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578965504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.724728:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578965504:12345-0@lo:400:kworker.0 Request processed in 35us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265481.724735:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789265481.724745:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789265481.724750:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578966016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.724778:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578966016:12345-0@lo:400:kworker.0 Request processed in 28us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265481.724784:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789265481.724793:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789265481.724798:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578965376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.724827:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578965376:12345-0@lo:400:kworker.0 Request processed in 29us (2486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265481.724833:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789265481.724844:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789265481.724849:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377813b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578965888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265481.724910:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377813b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578965888:12345-0@lo:400:kworker.0 Request processed in 61us (2538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265481.724915:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789265481.725214:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578964736:12345-0@lo:400:kworker.0 Request processed in 3373us (3769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265481.725223:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1789265481.725307:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265481.725312:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265481.725315:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265481.725319:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789265481.725367:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578964608:0@lo:400:kworker.0 00000100:00100000:2.0:1789265481.725384:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578965120:0@lo:400:kworker.0 00000100:00100000:2.0:1789265481.725411:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578965632:0@lo:400:kworker.0 00000100:00100000:2.0:1789265481.725424:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578964736:0@lo:400:kworker.0 00010000:00080000:2.0:1789265481.725441:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642753480 x1876180578965248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265481.725453:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578965248:0@lo:400:kworker.0 00010000:00080000:2.0:1789265481.725468:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642753b80 x1876180578965760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265481.725476:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180578965760:0@lo:400:kworker.0 00000100:00100000:2.0:1789265481.725540:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578964864:0@lo:400:kworker.0 00010000:00080000:2.0:1789265481.725553:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642752300 x1876180578965376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265481.725563:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578965376:0@lo:400:kworker.0 00010000:00080000:2.0:1789265481.725573:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642750380 x1876180578965888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265481.725580:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578965888:0@lo:400:kworker.0 00000100:00100000:2.0:1789265481.725601:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578964480:0@lo:400:kworker.0 00000100:00100000:2.0:1789265481.725613:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578964992:0@lo:400:kworker.0 00010000:00080000:2.0:1789265481.725624:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642751f80 x1876180578965504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265481.725633:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578965504:0@lo:400:kworker.0 00010000:00080000:2.0:1789265481.725656:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642751180 x1876180578966016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265481.725664:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578966016:0@lo:400:kworker.0 00000100:00100000:3.0:1789265482.227804:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578966144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265482.227963:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265482.228214:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578966144 00000100:00100000:0.0:1789265482.228225:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578966144 00000100:00100000:0.0:1789265482.228407:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789265482.228422:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578966144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265482.228463:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265482.228527:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578966144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (563us total) trans 0 rc 0/0 00010000:00080000:3.0:1789265482.229822:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36ce00 x1876180578966144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265482.229904:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578966144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265482.233611:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265482.233827:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578966272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265482.233971:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265482.234813:0:8437:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789265482.234831:0:8437:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1789265482.235339:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578966272 00000100:00100000:1.0:1789265482.235352:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578966272 00000100:00100000:0.0:1789265482.235721:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789265482.235758:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789265482.235772:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578966272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265482.235808:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265482.235941:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578966272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265482.235948:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1789265482.236060:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f387480 x1876180578966272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265482.236086:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578966272:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265482.291221:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265482.495309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265482.495376:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265482.495412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265482.495441:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265482.495490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265482.495671:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556859136 00000100:00100000:1.0:1789265482.495686:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556859136 00000100:00100000:1.0:1789265482.495760:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556859392 00000100:00100000:1.0:1789265482.495764:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556859392 00000100:00100000:1.0:1789265482.495778:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556859008 00000100:00100000:1.0:1789265482.495781:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556859008 00000100:00100000:1.0:1789265482.495793:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556859264 00000100:00100000:1.0:1789265482.495795:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556859264 00000100:00100000:1.0:1789265482.495812:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 189 00000100:00100000:1.0:1789265482.495822:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556859136:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265482.495951:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556859136:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 129us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265482.495959:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 189 00000100:00100000:1.0:1789265482.495982:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 190 00000100:00100000:1.0:1789265482.495988:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556859392:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265482.496011:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556859392:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265482.496028:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 190 00000100:00100000:1.0:1789265482.496040:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 191 00000100:00100000:1.0:1789265482.496046:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2399:x1876180556859008:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265482.496068:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2399:x1876180556859008:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265482.496073:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 191 00000100:00100000:1.0:1789265482.496082:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 192 00000100:00100000:1.0:1789265482.496088:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556859264:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265482.496123:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556859264:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 35us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265482.496130:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 192 00000100:00080000:0.0:1789265482.496949:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265482.496956:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789265482.497367:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556858880 00000100:00100000:2.0:1789265482.497379:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556858880 00000100:00100000:2.0:1789265482.497457:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 316 00000100:00100000:2.0:1789265482.497467:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:2399:x1876180556858880:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265482.497544:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:2399:x1876180556858880:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 78us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265482.497551:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 316 00000100:00100000:3.0:1789265483.251220:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578966400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265483.251303:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265483.251378:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578966400 00000100:00100000:3.0:1789265483.251385:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578966400 00000100:00100000:3.0:1789265483.251444:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789265483.251454:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578966400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265483.251486:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789265483.251531:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578966400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265483.251539:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789265483.251598:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578966400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265483.252699:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265483.252715:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578966528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265483.252765:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265483.252940:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578966528 00000100:00100000:2.0:1789265483.252947:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578966528 00000100:00100000:2.0:1789265483.254841:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789265483.254884:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578966528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265483.254934:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265483.255013:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578966528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265483.255020:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789265483.256764:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578966528:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1789265483.257898:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 100bb9bf-f94c-48f4-a13a-604931ad9e86 00000020:00000080:1.0:1789265483.257915:0:9512:0:(genops.c:885:class_export_put()) final put ffff937643357800/100bb9bf-f94c-48f4-a13a-604931ad9e86 00000020:00000080:2.0:1789265483.258201:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff937643357800/100bb9bf-f94c-48f4-a13a-604931ad9e86 for lustre-OST0001 00000020:00000080:2.0:1789265483.258254:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937643352000 for lustre-OST0001 00000001:00100000:0.0:1789265483.267647:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 100bb9bf-f94c-48f4-a13a-604931ad9e86 00000020:00000080:0.0:1789265483.267657:0:8429:0:(genops.c:885:class_export_put()) final put ffff937643356800/100bb9bf-f94c-48f4-a13a-604931ad9e86 00000020:00000080:1.0:1789265483.267711:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff937643356800/100bb9bf-f94c-48f4-a13a-604931ad9e86 for lustre-OST0000 00000020:00000080:1.0:1789265483.267770:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937643353800 for lustre-OST0000 00010000:00010000:3.0:1789265483.315290:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789265483.372803:0:13041:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789265483.765417:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578966784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265483.765491:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265483.765580:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265483.765601:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578966656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265483.765627:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265483.765767:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578966784 00000100:00100000:3.0:1789265483.765777:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578966784 00000100:00100000:3.0:1789265483.765832:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578966656 00000100:00100000:3.0:1789265483.765835:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578966656 00000100:00100000:3.0:1789265483.765850:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789265483.765886:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578966784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265483.765914:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265483.765956:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578966784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265483.765968:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789265483.765985:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789265483.765990:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578966656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265483.765998:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265483.766017:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578966656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 28us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265483.766023:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1789265483.766531:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265483.766591:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f386300 x1876180578966656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265483.766613:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578966656:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789265483.766625:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f36d880 x1876180578966784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265483.766636:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578966784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265484.341341:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265485.366288:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265486.387217:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265486.838107:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180578967040:0@lo:400:kworker.0 00000100:00100000:0.0:1789265486.838184:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578967296:0@lo:400:kworker.0 00000100:00100000:3.0:1789265486.838220:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265486.838266:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265486.838313:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578967808:0@lo:400:kworker.0 00000100:00100000:3.0:1789265486.838325:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180578967552:0@lo:400:kworker.0 00000100:00100000:0.0:1789265486.838346:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265486.838439:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578966912:0@lo:400:kworker.0 00000100:00100000:1.0:1789265486.838526:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578967168:0@lo:400:kworker.0 00000100:00100000:3.0:1789265486.842247:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265486.842345:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876180578968064:0@lo:400:kworker.0 00000100:00100000:3.0:1789265486.843604:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265486.844089:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578967040 00000100:00100000:3.0:1789265486.844101:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578967040 00000100:00100000:3.0:1789265486.844150:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578967296 00000100:00100000:3.0:1789265486.844153:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578967296 00000100:00100000:3.0:1789265486.844163:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578967552 00000100:00100000:3.0:1789265486.844166:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578967552 00000100:00100000:3.0:1789265486.844198:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578968064 00000100:00100000:3.0:1789265486.844200:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578968064 00000100:00100000:3.0:1789265486.844215:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789265486.844225:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180578967040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265486.844299:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180578967040:12345-0@lo:400:kworker.0 Request processed in 74us (6081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265486.844325:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789265486.844343:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789265486.844348:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578967296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265486.845545:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578968320:0@lo:400:kworker.0 00000100:00100000:0.0:1789265486.845627:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265486.845751:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578967296:12345-0@lo:400:kworker.0 Request processed in 1395us (7480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265486.845762:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789265486.845884:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578967296:0@lo:400:kworker.0 00000100:00100000:0.0:1789265486.845927:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578967808 00000100:00100000:0.0:1789265486.845934:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578967808 00000100:00100000:0.0:1789265486.845983:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578968320 00000100:00100000:0.0:1789265486.845987:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578968320 00000100:00100000:0.0:1789265486.846014:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789265486.846024:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578967808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265486.846058:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789265486.846076:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180578967552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265486.846093:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578967808:12345-0@lo:400:kworker.0 Request processed in 68us (7746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265486.846102:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789265486.846124:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789265486.846138:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578968320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265486.846146:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180578967552:12345-0@lo:400:kworker.0 Request processed in 74us (3905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265486.846155:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789265486.846174:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789265486.846185:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876180578968064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265486.846216:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578968320:12345-0@lo:400:kworker.0 Request processed in 83us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265486.846225:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789265486.846239:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876180578968064:12345-0@lo:400:kworker.0 Request processed in 53us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265486.846248:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:3.0:1789265486.846293:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265486.846298:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265486.846302:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265486.847693:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180578967552:0@lo:400:kworker.0 00000100:00100000:3.0:1789265486.847725:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876180578968064:0@lo:400:kworker.0 00000100:00100000:3.0:1789265486.847742:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180578967040:0@lo:400:kworker.0 00010000:00080000:0.0:1789265486.849641:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775dc27100 x1876180578967808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265486.849666:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578967808:0@lo:400:kworker.0 00010000:00080000:0.0:1789265486.849708:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775dc27480 x1876180578968320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265486.849718:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578968320:0@lo:400:kworker.0 00000100:00100000:2.0:1789265486.851442:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265486.851513:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578967424:0@lo:400:kworker.0 00000100:00100000:3.0:1789265486.851522:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578966912 00000100:00100000:3.0:1789265486.851553:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578966912 00000100:00100000:2.0:1789265486.851581:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265486.851624:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578967936:0@lo:400:kworker.0 00000100:00100000:2.0:1789265486.851659:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265486.851682:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789265486.851697:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578966912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265486.851714:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578967936 00000100:00100000:2.0:1789265486.851724:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578967936 00000100:00100000:0.0:1789265486.851754:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578967424 00000100:00100000:0.0:1789265486.851759:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578967424 00000100:00100000:2.0:1789265486.851792:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789265486.851794:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789265486.851804:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578967936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265486.851806:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578967424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265486.851821:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578966912:12345-0@lo:400:kworker.0 Request processed in 127us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265486.851832:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789265486.851909:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578967424:12345-0@lo:400:kworker.0 Request processed in 106us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265486.851918:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1789265486.853003:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265486.854620:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265486.854688:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578967680:0@lo:400:kworker.0 00000100:00100000:1.0:1789265486.854733:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265486.854762:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578968192:0@lo:400:kworker.0 00000100:00100000:0.0:1789265486.854768:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578967168 00000100:00100000:0.0:1789265486.854778:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578967168 00000100:00100000:1.0:1789265486.854784:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265486.854825:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789265486.854834:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578967168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265486.854921:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578967168:12345-0@lo:400:kworker.0 Request processed in 88us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265486.854929:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789265486.855249:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578967168:0@lo:400:kworker.0 00000100:00100000:2.0:1789265486.855336:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578967936:12345-0@lo:400:kworker.0 Request processed in 3533us (3678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265486.855345:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1789265486.856162:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775dc24e00 x1876180578967936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265486.856181:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578967936:0@lo:400:kworker.0 00000100:00100000:3.0:1789265486.856208:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578967680 00000100:00100000:3.0:1789265486.856215:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578967680 00000100:00100000:3.0:1789265486.856355:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578968192 00000100:00100000:3.0:1789265486.856359:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578968192 00000100:00100000:1.0:1789265486.856396:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789265486.856429:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578967680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265486.856457:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578968448:0@lo:400:kworker.0 00000100:00100000:2.0:1789265486.856528:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265486.856632:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578966912:0@lo:400:kworker.0 00000100:00100000:2.0:1789265486.856648:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578967424:0@lo:400:kworker.0 00000100:00100000:1.0:1789265486.856679:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578967680:12345-0@lo:400:kworker.0 Request processed in 254us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265486.856689:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:1.0:1789265486.856733:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775dc25c00 x1876180578967680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265486.856746:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578967680:0@lo:400:kworker.0 00000100:00080000:0.0:1789265486.862358:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265486.864053:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578968448 00000100:00100000:0.0:1789265486.864097:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578968448 00000100:00080000:1.0:1789265486.864185:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265486.868313:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789265486.868740:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578968448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265486.868916:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578968448:12345-0@lo:400:kworker.0 Request processed in 580us (12387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265486.868925:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1789265486.869176:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775dc24380 x1876180578968448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265486.869196:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578968448:0@lo:400:kworker.0 00000100:00100000:3.0:1789265486.869953:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789265486.869969:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578968192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265486.870050:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578968192:12345-0@lo:400:kworker.0 Request processed in 86us (15263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265486.870057:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00080000:0.0:1789265486.870196:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775dc25f80 x1876180578968192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265486.870211:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578968192:0@lo:400:kworker.0 00000020:00000080:2.0:1789265487.070202:0:13190:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc4798460 20000000:00000080:2.0:1789265487.070279:0:13190:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9377810bd400 uarg=0000000000000000 20000000:01000000:2.0:1789265487.070346:0:13190:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789265487.070353:0:13190:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789265487.070359:0:13190:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789265487.071495:0:13191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789265487.071728:0:13190:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789265487.091746:0:13190:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789265487.091840:0:13190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.091916:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937642393000/0xbbfdc9019c1d3aaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3aa8 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.091927:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d3abd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3ab6 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.091940:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d3ac4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919064 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.091977:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937643219c00/0xbbfdc9019c1d3ad2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3acb expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.091986:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ae0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3ad9 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.091995:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3af5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190a3 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.092002:0:13190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.092079:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3af5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190a3 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.092096:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3af5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190a3 expref: 12 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265487.092114:0:13190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643559500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876180578968576:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265487.093711:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3ad9 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.093730:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ae0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3ad9 expref: 23 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265487.093747:0:13190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643559180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876180578968704:0@lo:104: 00000100:00100000:3.0:1789265487.093826:0:13190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265487.093904:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937643219c00/0xbbfdc9019c1d3ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3acb expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.093929:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937643219c00/0xbbfdc9019c1d3ad2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3acb expref: 23 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265487.093938:0:13190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764355aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876180578968832:0@lo:104: 00000100:00100000:3.0:1789265487.093981:0:13190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265487.094013:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d3ac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919064 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.094023:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d3ac4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919064 expref: 12 pid: 6513 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265487.094033:0:13190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876180578968960:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265487.094065:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d3abd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3ab6 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.094074:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d3abd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3ab6 expref: 23 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265487.094082:0:13190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876180578969088:0@lo:104: 00000100:00100000:3.0:1789265487.094104:0:13190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265487.094121:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937642393000/0xbbfdc9019c1d3aaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3aa8 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.094129:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff937642393000/0xbbfdc9019c1d3aaf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3aa8 expref: 23 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265487.094138:0:13190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876180578969216:0@lo:104: 00000100:00100000:3.0:1789265487.094170:0:13190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265487.094200:0:13190:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e6100c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265487.094514:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578968704 00000100:00100000:1.0:1789265487.094524:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578968704 00000100:00100000:1.0:1789265487.094594:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578968832 00000100:00100000:1.0:1789265487.094598:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578968832 00000100:00100000:1.0:1789265487.094616:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578969088 00000100:00100000:1.0:1789265487.094619:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578969088 00000100:00100000:1.0:1789265487.094627:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578969216 00000100:00100000:1.0:1789265487.094629:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578969216 00000100:00100000:1.0:1789265487.094645:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789265487.094656:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643559f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+6:13190:x1876180578968704:12345-0@lo:104: 00010000:00010000:1.0:1789265487.094673:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3ae0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.094746:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265487.094752:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643559f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+6:13190:x1876180578968704:12345-0@lo:104: Request processed in 98us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265487.094759:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789265487.094781:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789265487.094787:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+5:13190:x1876180578968832:12345-0@lo:104: 00010000:00010000:1.0:1789265487.094803:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3ad2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.094835:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789265487.094840:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+5:13190:x1876180578968832:12345-0@lo:104: Request processed in 54us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265487.094846:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789265487.094876:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789265487.094884:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+4:13190:x1876180578969088:12345-0@lo:104: 00010000:00010000:1.0:1789265487.094891:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3abd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.094916:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789265487.094921:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+4:13190:x1876180578969088:12345-0@lo:104: Request processed in 39us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265487.094927:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789265487.094942:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789265487.094947:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+3:13190:x1876180578969216:12345-0@lo:104: 00010000:00010000:1.0:1789265487.094954:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3aaf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.094998:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789265487.095003:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:50e161d8-da73-42e3-8b96-d311cd2235de+3:13190:x1876180578969216:12345-0@lo:104: Request processed in 56us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265487.095010:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789265487.095030:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789265487.095037:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3ae0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095051:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393400 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265487.095055:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3ae0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095064:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3ae0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265487.095072:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3ae0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265487.095078:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265487.095115:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3ae0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095123:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265487.095151:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3ae0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095159:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937642393400/0xbbfdc9019c1d3ad9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3ae0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095174:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789265487.095178:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3ad2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095185:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bcc00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265487.095189:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3ad2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095208:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3ad2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265487.095215:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3ad2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265487.095220:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265487.095249:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3ad2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095255:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265487.095280:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3ad2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095288:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d3acb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3ad2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265487.095291:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578969472:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265487.095302:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265487.095306:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3abd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095313:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc200 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265487.095316:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3abd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095324:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3abd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265487.095331:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3abd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265487.095344:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789265487.095350:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265487.095374:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3abd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095380:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265487.095387:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3abd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265487.095391:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789265487.095398:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3ab6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3abd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265487.095402:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578969600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265487.095417:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265487.095421:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3aaf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095428:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fda00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265487.095432:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3aaf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265487.095435:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265487.095444:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3aaf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265487.095451:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3aaf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265487.095457:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265487.095472:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3aaf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095478:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265487.095490:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3aaf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095496:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3aa8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3aaf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095512:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265487.095514:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265487.095522:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265487.095530:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265487.095553:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578969344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265487.095581:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265487.095612:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265487.095618:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764354c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578969728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265487.095637:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265487.095660:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578969472 00000100:00100000:2.0:1789265487.095668:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578969472 00000100:00100000:1.0:1789265487.095682:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578969600 00000100:00100000:1.0:1789265487.095687:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578969600 00010000:00010000:2.0:1789265487.095702:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937643219c00/0xbbfdc9019c1d3ad2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3acb expref: 25 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095707:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d3abd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3ab6 expref: 25 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265487.095729:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578969344 00000100:00100000:1.0:1789265487.095731:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578969728 00000100:00100000:2.0:1789265487.095735:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578969344 00000100:00100000:1.0:1789265487.095737:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578969728 00010000:00010000:2.0:1789265487.095754:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ae0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3ad9 expref: 27 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.095756:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937642393000/0xbbfdc9019c1d3aaf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3aa8 expref: 27 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265487.095785:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265487.095801:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+27:3643:x1876180578969472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265487.095817:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265487.095823:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937643219c00/0xbbfdc9019c1d3ad2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3acb expref: 27 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265487.095834:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937643219c00/0xbbfdc9019c1d3ad2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3acb expref: 27 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265487.095854:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265487.095912:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+27:3643:x1876180578969472:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265487.096169:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789265487.098677:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+27:3643:x1876180578969600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265487.098807:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265487.098820:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d3abd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3ab6 expref: 27 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.098890:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d3abd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3ab6 expref: 27 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.099033:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265487.099139:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+27:3643:x1876180578969600:12345-0@lo:103:ldlm_bl.0 Request processed in 501us (3704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265487.099162:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789265487.099383:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789265487.099393:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+26:3646:x1876180578969344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265487.099404:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265487.099410:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ae0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3ad9 expref: 26 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.099419:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ae0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3ad9 expref: 26 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.099430:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265487.099466:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+26:3646:x1876180578969344:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (3883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265487.099473:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789265487.099491:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265487.099499:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+25:3646:x1876180578969728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265487.099507:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265487.099511:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937642393000/0xbbfdc9019c1d3aaf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3aa8 expref: 25 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.099518:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937642393000/0xbbfdc9019c1d3aaf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3aa8 expref: 25 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.099546:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265487.099570:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+25:3646:x1876180578969728:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (3931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265487.099576:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265487.099651:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764354c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578969728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265487.099663:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578969344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265487.101434:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578969600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265487.101452:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578969472:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265487.101727:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ae0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3ad9 expref: 24 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265487.101747:0:13190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643559180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876180578968704:0@lo:104: 00010000:00010000:1.0:1789265487.101761:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643219c00/0xbbfdc9019c1d3ad2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3acb expref: 23 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265487.101770:0:13190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764355aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876180578968832:0@lo:104: 00010000:00010000:1.0:1789265487.101783:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d3abd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3ab6 expref: 22 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265487.101793:0:13190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876180578969088:0@lo:104: 00010000:00010000:1.0:1789265487.101805:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937642393000/0xbbfdc9019c1d3aaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3aa8 expref: 21 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265487.101814:0:13190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876180578969216:0@lo:104: 00000100:00100000:2.0:1789265487.104276:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789265487.109044:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265487.109086:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265487.109210:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556859520 00000100:00100000:2.0:1789265487.109221:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556859520 00010000:00010000:2.0:1789265487.109268:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3af5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190a3 expref: 13 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265487.109300:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556859648 00000100:00100000:2.0:1789265487.109301:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556859648 00010000:00010000:2.0:1789265487.109311:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d3ac4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919064 expref: 14 pid: 6513 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265487.109326:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:2.0:1789265487.109334:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643caf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:63f6cd89-abac-4801-8de9-f59ae281263f+14:2400:x1876180556859520:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265487.109349:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265487.109364:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3af5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190a3 expref: 14 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265487.109374:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 45 00010000:00010000:2.0:1789265487.109379:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3af5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190a3 expref: 14 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265487.109388:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f67f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+14:2400:x1876180556859648:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265487.109399:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265487.109407:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d3ac4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919064 expref: 14 pid: 6513 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.109419:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d3ac4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919064 expref: 14 pid: 6513 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265487.109461:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3af5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190a3 expref: 14 pid: 6514 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265487.109480:0:13190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643559500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876180578968576:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265487.109502:0:13190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876180578968960:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265487.110568:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265487.110589:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d3ac4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919064 expref: 13 pid: 6513 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.110610:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.110620:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.110639:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.110646:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.110653:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.110659:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.110676:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643218200 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265487.110681:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.110691:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.110701:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265487.110712:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265487.110792:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f67f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+12:2400:x1876180556859648:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 1408us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265487.110799:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 45 00010000:00010000:1.0:1789265487.110930:0:13190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265487.111069:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643caf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:63f6cd89-abac-4801-8de9-f59ae281263f+11:2400:x1876180556859520:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 1732us (2039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265487.111079:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 44 00010000:00010000:0.0:1789265487.111412:0:13190:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.111422:0:13190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265487.111429:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643218200/0xbbfdc9019c1d3b18 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265487.347285:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578969856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265487.347379:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265487.347666:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578969984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265487.347696:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265487.347788:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578969856 00000100:00100000:0.0:1789265487.347798:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578969856 00000100:00100000:0.0:1789265487.347884:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578969984 00000100:00100000:0.0:1789265487.347887:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578969984 00000100:00100000:0.0:1789265487.347905:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789265487.347915:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578969856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265487.347951:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265487.348035:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578969856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265487.348043:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789265487.348062:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789265487.348068:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578969984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265487.348080:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265487.348106:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578969984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265487.348112:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1789265487.348301:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2ffb80 x1876180578969984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265487.348325:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578969984:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789265487.348361:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643cadc00 x1876180578969856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265487.348372:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578969856:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789265487.411010:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265487.614355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265487.616875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265487.616923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265487.616955:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265487.616996:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265487.617052:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556860032 00000100:00100000:0.0:1789265487.617065:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556860032 00000100:00100000:0.0:1789265487.617129:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556860288 00000100:00100000:0.0:1789265487.617149:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556860288 00000100:00100000:0.0:1789265487.617166:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556859904 00000100:00100000:0.0:1789265487.617168:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556859904 00000100:00100000:0.0:1789265487.617180:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556860160 00000100:00100000:0.0:1789265487.617182:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556860160 00000100:00100000:0.0:1789265487.617199:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 199 00000100:00100000:0.0:1789265487.617211:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556860032:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265487.617308:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556860032:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 99us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265487.617316:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 199 00000100:00100000:0.0:1789265487.617334:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 200 00000100:00100000:0.0:1789265487.617358:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556860288:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265487.617402:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556860288:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 43us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265487.617408:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 200 00000100:00100000:0.0:1789265487.617420:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 201 00000100:00100000:0.0:1789265487.617426:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556859904:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265487.617439:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 202 00000100:00100000:0.0:1789265487.617449:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556859904:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265487.617450:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556860160:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265487.617456:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 201 00000100:00100000:1.0:1789265487.617477:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556860160:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00080000:0.0:1789265487.617481:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265487.617483:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 202 00000100:00080000:0.0:1789265487.617486:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265487.620095:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556859776 00000100:00100000:3.0:1789265487.620116:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556859776 00000100:00100000:1.0:1789265487.620412:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 318 00000100:00100000:1.0:1789265487.620426:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+11:2400:x1876180556859776:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265487.620739:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+11:2400:x1876180556859776:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 99us (6184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265487.620771:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 318 10000000:01000000:2.0:1789265488.371128:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265488.371139:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff937641a6a800 from 7 10000000:01000000:2.0:1789265488.371146:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265488.371209:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265488.371223:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265488.371237:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265488.371270:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376426dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578970112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265488.371365:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265488.371447:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377412540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265488.371507:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578970112 00000100:00100000:1.0:1789265488.371518:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578970112 00000100:00100000:1.0:1789265488.371600:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789265488.371612:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775011b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578970112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265488.371629:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265488.371649:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bd200/0xbbfdc9019c1d3b26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3b1f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265488.371680:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bd200/0xbbfdc9019c1d3b26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3b1f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265488.371692:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bd200/0xbbfdc9019c1d3b26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3b1f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265488.371704:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd200, rc 0) 00000100:00100000:1.0:1789265488.371763:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775011b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578970112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265488.371770:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789265488.372305:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376426dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578970112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265488.372326:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3b26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265488.372337:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3b26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265488.372433:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578970368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265488.372469:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265488.372496:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377610f4600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265488.372575:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376426de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578970240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265488.372611:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265488.372661:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578970368 00000100:00100000:1.0:1789265488.372666:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578970368 00000100:00100000:1.0:1789265488.372698:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789265488.372707:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578970368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265488.372853:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578970368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265488.372903:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789265488.372989:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578970240 00000100:00100000:0.0:1789265488.372994:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578970240 00000100:00100000:0.0:1789265488.373035:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789265488.373043:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578970240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265488.373076:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265488.373127:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578970240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265488.373134:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789265488.373165:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578970368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265488.373201:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578970496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265488.373247:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265488.373271:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377610f4600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265488.373286:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578970496 00000100:00100000:0.0:1789265488.373289:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578970496 00000100:00100000:0.0:1789265488.373311:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789265488.373317:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578970496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265488.373410:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578970496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265488.373416:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789265488.373458:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578970496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789265488.374188:0:13219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789265488.374264:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789265488.374284:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265488.374296:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3b26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265488.374306:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3b26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265488.374317:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265488.374321:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93777aaec000 from 7 10000000:01000000:0.0:1789265488.374324:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265488.374370:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265488.374395:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265488.374406:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265488.374429:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578970624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265488.374475:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265488.374495:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377610f4600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265488.374964:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376426de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578970240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265488.375004:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578970624 00000100:00100000:1.0:1789265488.375010:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578970624 00000100:00100000:1.0:1789265488.375056:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789265488.375064:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578970624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265488.375079:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265488.375095:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3b34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3b2d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265488.375121:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3b34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3b2d expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265488.375134:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3b34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3b2d expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265488.375144:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd800, rc 0) 00000100:00100000:1.0:1789265488.375184:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578970624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265488.375190:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789265488.375898:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265488.375915:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764354c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578970752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265488.375960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265488.376001:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578970752 00000100:00100000:1.0:1789265488.376007:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578970752 00000100:00100000:1.0:1789265488.376044:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789265488.376052:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578970752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265488.376100:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265488.376144:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578970752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265488.376152:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789265488.376196:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764354c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578970752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265488.377563:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578970624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265488.377595:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3b34 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265488.377611:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3b34 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265488.377715:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578970880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265488.377777:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265488.377823:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377610f4600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265488.378510:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578970880 00000100:00100000:1.0:1789265488.378517:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578970880 00000100:00100000:1.0:1789265488.378589:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789265488.378602:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578970880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265488.378787:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578970880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265488.378795:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789265488.378893:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578970880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265488.378942:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578971008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265488.379001:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265488.379031:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937782141300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265488.379090:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578971008 00000100:00100000:2.0:1789265488.379104:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578971008 00000100:00100000:2.0:1789265488.379142:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789265488.379149:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578971008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265488.379252:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578971008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265488.379259:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789265488.379339:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578971008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789265488.380980:0:13221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789265488.381360:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789265488.381405:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265488.381420:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3b34 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265488.381434:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3b34 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265488.381448:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265488.381451:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93774e5c3000 from 7 10000000:01000000:2.0:1789265488.381455:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265488.381511:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265488.381520:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265488.381612:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265488.381642:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376426de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578971136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265488.381726:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265488.381781:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377412540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265488.381948:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578971136 00000100:00100000:1.0:1789265488.381957:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578971136 00000100:00100000:1.0:1789265488.382014:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789265488.382025:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578971136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265488.382041:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265488.382056:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d3b42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3b3b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265488.382083:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d3b42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3b3b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265488.382092:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d3b42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3b3b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265488.382101:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd600, rc 0) 00000100:00100000:1.0:1789265488.382166:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578971136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265488.382173:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789265488.382259:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376426de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578971136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265488.382275:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3b42 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265488.382285:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3b42 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265488.382351:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376426de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578971264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265488.382385:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265488.382462:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377412540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265488.382479:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578971264 00000100:00100000:1.0:1789265488.382483:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578971264 00000100:00100000:2.0:1789265488.382514:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789265488.382603:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578971264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265488.382773:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578971264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265488.382780:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789265488.382834:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376426de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578971264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265488.383316:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578971392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265488.383398:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265488.383435:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377412540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265488.384506:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578971392 00000100:00100000:1.0:1789265488.384517:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578971392 00000100:00100000:1.0:1789265488.384585:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789265488.384595:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578971392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265488.384744:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578971392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265488.384752:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789265488.384774:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578971392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789265488.386603:0:13222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789265488.387403:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789265488.387437:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265488.387452:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3b42 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265488.387467:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3b42 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265488.387482:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789265488.387485:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff937779e62800 from 7 10000000:01000000:3.0:1789265488.387489:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265488.387557:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265488.387566:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265488.387580:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265488.387610:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578971520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265488.387693:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265488.387745:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937782141300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265488.389110:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578971520 00000100:00100000:2.0:1789265488.389126:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578971520 00000100:00100000:2.0:1789265488.389213:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789265488.389226:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578971520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265488.389247:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265488.389268:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d3b50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3b49 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265488.389303:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d3b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3b49 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265488.389317:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d3b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3b49 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265488.389329:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd600, rc 0) 00000100:00100000:2.0:1789265488.390993:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578971520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1757us (3287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265488.391007:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789265488.391130:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578971520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265488.391171:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3b50 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265488.391186:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3b50 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265488.391296:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578971648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265488.391352:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265488.391442:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937782141300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265488.391646:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578971648 00000100:00100000:2.0:1789265488.391654:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578971648 00000100:00100000:2.0:1789265488.391703:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789265488.391721:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578971648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265488.393334:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578971648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1607us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265488.393349:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789265488.395067:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578971648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265488.396399:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578971776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265488.396503:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265488.396631:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937782141300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265488.402686:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578971776 00000100:00100000:1.0:1789265488.402709:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578971776 00000100:00100000:1.0:1789265488.402817:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789265488.402833:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578971776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265488.403634:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578971776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 802us (7127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265488.403647:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789265488.403781:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578971776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789265488.406302:0:13224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789265488.410076:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789265488.410124:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265488.410139:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3b50 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265488.410155:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3b50 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265488.435035:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265488.886578:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265488.886619:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578971904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265488.886719:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265488.886951:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578972032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265488.886989:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265488.887161:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578971904 00000100:00100000:0.0:1789265488.887171:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578971904 00000100:00100000:2.0:1789265488.887187:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578972032 00000100:00100000:2.0:1789265488.887195:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578972032 00000100:00100000:0.0:1789265488.887257:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789265488.887269:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578971904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265488.887326:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265488.887399:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578971904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265488.887407:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1789265488.887468:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265488.888211:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2fc700 x1876180578971904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265488.888243:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578971904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265488.890928:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789265488.890960:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578972032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265488.891162:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265488.891414:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578972032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 471us (4422us total) trans 0 rc 0/0 00010000:00080000:0.0:1789265488.894487:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643cae680 x1876180578972032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265488.894539:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578972032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265488.895046:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789265489.021530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265489.021692:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556860416 00000100:00100000:1.0:1789265489.021706:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556860416 00000100:00100000:1.0:1789265489.021781:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 331 00000100:00100000:1.0:1789265489.021804:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+11:6173:x1876180556860416:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265489.021827:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265489.021849:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d3b57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9190d4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265489.021925:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d3b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190d4 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265489.021939:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d3b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190d4 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265489.021950:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc600, rc 0) 00000100:00100000:1.0:1789265489.022025:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+12:6173:x1876180556860416:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 224us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265489.022033:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 331 00000100:00100000:0.0:1789265489.024084:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265489.024185:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556860544 00000100:00100000:1.0:1789265489.024198:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556860544 00000100:00100000:1.0:1789265489.024264:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 332 00000100:00100000:1.0:1789265489.024275:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+12:6173:x1876180556860544:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265489.026486:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+12:6173:x1876180556860544:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 2199us (2400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265489.026503:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 332 00000100:00100000:3.0:1789265489.030801:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265489.036156:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556860672 00000100:00100000:0.0:1789265489.036179:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556860672 00000100:00100000:1.0:1789265489.036407:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 333 00000100:00100000:1.0:1789265489.036420:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+12:6173:x1876180556860672:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265489.036640:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+12:6173:x1876180556860672:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 221us (5847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265489.036660:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 333 00000100:00100000:0.0:1789265489.062568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265489.063507:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556860800 00000100:00100000:2.0:1789265489.063532:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556860800 00000100:00100000:2.0:1789265489.063609:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 334 00000100:00100000:2.0:1789265489.063619:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+12:6173:x1876180556860800:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265489.063638:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265489.063657:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9376435fd400/0xbbfdc9019c1d3b5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9190db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265489.063687:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fd400/0xbbfdc9019c1d3b5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190db expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265489.063696:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9376435fd400/0xbbfdc9019c1d3b5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190db expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265489.063705:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd400, rc 0) 00000100:00100000:2.0:1789265489.063774:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:6173:x1876180556860800:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 157us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265489.063782:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 334 00000100:00100000:0.0:1789265489.073202:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265489.073300:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556860928 00000100:00100000:3.0:1789265489.073315:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556860928 00000100:00100000:3.0:1789265489.073390:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 335 00000100:00100000:3.0:1789265489.073403:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:6173:x1876180556860928:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265489.073636:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:6173:x1876180556860928:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 235us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265489.073645:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 335 00000100:00100000:0.0:1789265489.083006:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265489.083154:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556861056 00000100:00100000:1.0:1789265489.083168:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556861056 00000100:00100000:1.0:1789265489.083290:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 336 00000100:00100000:1.0:1789265489.083301:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:6173:x1876180556861056:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265489.083585:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:6173:x1876180556861056:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 273us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265489.083595:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 336 00010000:00010000:2.0:1789265489.462391:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265490.484581:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789265491.413914:0:13388:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789265491.508242:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265491.959716:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265491.959750:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578972160:0@lo:400:kworker.0 00000100:00100000:2.0:1789265491.960422:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265491.960544:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265491.961324:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578972672:0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.961381:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265491.961412:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578973184:0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.961439:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265491.961455:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578972800:0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.961457:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578973696:0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.961479:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265491.961497:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265491.961519:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180578973312:0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.961521:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789265491.961526:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578972544:0@lo:400:kworker.0 00000100:00100000:3.0:1789265491.961542:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265491.961891:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578972672 00000100:00100000:1.0:1789265491.961902:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578972672 00000100:00100000:1.0:1789265491.961974:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789265491.961985:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578972672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265491.962724:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578972160 00000100:00100000:0.0:1789265491.962734:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578972160 00000100:00100000:2.0:1789265491.962893:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578972416:0@lo:400:kworker.0 00000100:00100000:0.0:1789265491.966365:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789265491.966409:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3643:x1876180578972160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.967455:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578972672:12345-0@lo:400:kworker.0 Request processed in 5464us (6067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265491.967469:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789265491.968152:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3643:x1876180578972160:12345-0@lo:400:kworker.0 Request processed in 1756us (7728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265491.968165:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789265491.968658:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578973184 00000100:00100000:1.0:1789265491.968688:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578973184 00000100:00100000:1.0:1789265491.968770:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578973696 00000100:00100000:1.0:1789265491.968774:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578973696 00000100:00100000:1.0:1789265491.968818:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789265491.968829:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578973184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.968912:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578973184:12345-0@lo:400:kworker.0 Request processed in 86us (7472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265491.968919:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789265491.968934:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789265491.968941:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578973696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.968987:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578973696:12345-0@lo:400:kworker.0 Request processed in 46us (7506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265491.968992:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1789265491.969035:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265491.969040:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265491.969080:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578972800 00000100:00100000:1.0:1789265491.969084:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578972800 00000100:00100000:1.0:1789265491.969117:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578973312 00000100:00100000:1.0:1789265491.969121:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578973312 00000100:00100000:1.0:1789265491.969142:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789265491.969148:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578972800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.969186:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578972800:12345-0@lo:400:kworker.0 Request processed in 38us (7697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265491.969192:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789265491.969205:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789265491.969211:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180578973312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.969252:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180578973312:12345-0@lo:400:kworker.0 Request processed in 41us (7709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265491.969264:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:1.0:1789265491.969279:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265491.969320:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578972160:0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.969413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265491.969451:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578973056:0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.969487:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265491.969517:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578973568:0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.969537:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265491.969579:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578972672:0@lo:400:kworker.0 00010000:00080000:1.0:1789265491.969595:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775dc24380 x1876180578973184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265491.969605:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578973184:0@lo:400:kworker.0 00010000:00080000:1.0:1789265491.969616:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775dc27480 x1876180578973696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265491.969624:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578973696:0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.969651:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578973056 00000100:00100000:1.0:1789265491.969655:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578973056 00000100:00100000:1.0:1789265491.969682:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578973568 00000100:00100000:1.0:1789265491.969685:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578973568 00000100:00100000:1.0:1789265491.969704:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789265491.969710:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578973056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.969747:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578973056:12345-0@lo:400:kworker.0 Request processed in 37us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265491.969753:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789265491.969775:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789265491.969781:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578973568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.969809:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578973568:12345-0@lo:400:kworker.0 Request processed in 28us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265491.969815:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789265491.969829:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265491.969832:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265491.969843:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578972544 00000100:00100000:1.0:1789265491.969846:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578972544 00000100:00100000:1.0:1789265491.969902:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789265491.969909:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578972544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.969938:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578972544:12345-0@lo:400:kworker.0 Request processed in 30us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265491.969944:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789265491.969971:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578972544:0@lo:400:kworker.0 00010000:00080000:1.0:1789265491.969981:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775dc25f80 x1876180578973056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265491.969990:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578973056:0@lo:400:kworker.0 00010000:00080000:1.0:1789265491.969998:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775dc24e00 x1876180578973568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265491.970007:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578973568:0@lo:400:kworker.0 00000100:00100000:3.0:1789265491.970969:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180578973312:0@lo:400:kworker.0 00000100:00100000:3.0:1789265491.971001:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578972800:0@lo:400:kworker.0 00000100:00100000:2.0:1789265491.978846:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265491.978947:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180578972928:0@lo:400:kworker.0 00000100:00100000:2.0:1789265491.979391:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265491.979434:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180578973440:0@lo:400:kworker.0 00000100:00100000:2.0:1789265491.979460:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265491.979498:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180578972288:0@lo:400:kworker.0 00000100:00100000:2.0:1789265491.979523:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265491.979722:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578972928 00000100:00100000:2.0:1789265491.979732:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578972928 00000100:00100000:2.0:1789265491.979893:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578973440 00000100:00100000:2.0:1789265491.979898:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578973440 00000100:00100000:2.0:1789265491.979916:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578972288 00000100:00100000:2.0:1789265491.980089:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578972288 00000100:00100000:1.0:1789265491.980156:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578972416 00000100:00100000:3.0:1789265491.980161:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789265491.980161:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578972416 00000100:00100000:3.0:1789265491.980174:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180578972928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265491.980209:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789265491.980225:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578972416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265491.980251:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180578972928:12345-0@lo:400:kworker.0 Request processed in 80us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265491.980377:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578972416:12345-0@lo:400:kworker.0 Request processed in 161us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265491.980384:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789265491.985981:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789265491.986057:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789265491.986082:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180578973440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265491.986215:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180578973440:12345-0@lo:400:kworker.0 Request processed in 148us (6753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265491.986223:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789265491.986238:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789265491.986247:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180578972288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265491.986282:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180578972288:12345-0@lo:400:kworker.0 Request processed in 37us (6758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265491.986310:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:3.0:1789265491.987566:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789265491.994749:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578972416:0@lo:400:kworker.0 00010000:00080000:2.0:1789265491.995157:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2ffb80 x1876180578972928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265491.995172:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180578972928:0@lo:400:kworker.0 00010000:00080000:2.0:1789265491.995395:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775dc24a80 x1876180578973440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265491.995407:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180578973440:0@lo:400:kworker.0 00000100:00100000:2.0:1789265491.995422:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180578972288:0@lo:400:kworker.0 00000100:00100000:3.0:1789265492.467312:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578973824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265492.467354:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578973952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265492.467417:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265492.467526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265492.467721:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578973824 00000100:00100000:1.0:1789265492.467741:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578973824 00000100:00100000:1.0:1789265492.467830:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578973952 00000100:00100000:1.0:1789265492.467846:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578973952 00000100:00100000:1.0:1789265492.467889:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789265492.467901:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578973824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265492.467954:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265492.468017:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578973824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265492.468026:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789265492.468049:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789265492.468056:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578973952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265492.468068:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265492.475521:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578973952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7448us (7977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265492.475541:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1789265492.475687:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643559180 x1876180578973824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265492.475720:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578973824:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789265492.476721:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775dc27100 x1876180578973952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265492.477323:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578973952:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789265492.531910:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265492.735072:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265492.735150:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265492.735179:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265492.735212:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265492.735254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265492.735281:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556861312 00000100:00100000:1.0:1789265492.735290:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556861312 00000100:00100000:1.0:1789265492.735353:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556861568 00000100:00100000:1.0:1789265492.735357:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556861568 00000100:00100000:1.0:1789265492.735372:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556861440 00000100:00100000:1.0:1789265492.735375:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556861440 00000100:00100000:1.0:1789265492.735387:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556861696 00000100:00100000:1.0:1789265492.735389:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556861696 00000100:00100000:1.0:1789265492.735404:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 209 00000100:00100000:1.0:1789265492.735414:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2398:x1876180556861312:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265492.735504:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2398:x1876180556861312:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 91us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265492.735512:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 209 00000100:00100000:1.0:1789265492.735529:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 210 00000100:00100000:1.0:1789265492.735536:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556861568:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265492.735564:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556861568:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 29us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265492.735571:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 210 00000100:00100000:1.0:1789265492.735583:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 211 00000100:00100000:1.0:1789265492.735589:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556861440:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265492.735610:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556861440:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265492.735617:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 211 00000100:00100000:1.0:1789265492.735628:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 212 00000100:00100000:1.0:1789265492.735634:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556861696:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265492.735667:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556861696:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 33us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265492.735674:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 212 00000100:00080000:1.0:1789265492.735695:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265492.735698:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265492.737609:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556861184 00000100:00100000:0.0:1789265492.737622:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556861184 00000100:00100000:1.0:1789265492.737830:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 338 00000100:00100000:1.0:1789265492.737842:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556861184:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265492.737944:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556861184:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 103us (2882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265492.737951:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 338 00000100:00100000:1.0:1789265493.491038:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578974080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265493.491110:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265493.491178:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578974080 00000100:00100000:1.0:1789265493.491185:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578974080 00000100:00100000:1.0:1789265493.491222:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789265493.491231:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578974080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265493.491268:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265493.491331:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578974080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265493.494353:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578974208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265493.494429:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265493.494551:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578974080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265493.494684:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578974208 00000100:00100000:3.0:1789265493.494692:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578974208 00000100:00100000:1.0:1789265493.503025:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789265493.504836:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789265493.505407:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578974208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265493.508441:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265493.508816:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578974208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265493.508946:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578974208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3711us (14133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265493.508957:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00010000:2.0:1789265493.555551:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265494.005794:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578974336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265494.005903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265494.006017:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578974336 00000100:00100000:1.0:1789265494.006020:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578974464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265494.006034:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578974336 00000100:00100000:1.0:1789265494.006058:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265494.006098:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578974464 00000100:00080000:1.0:1789265494.006101:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265494.006103:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578974464 00000100:00100000:1.0:1789265494.006121:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789265494.006135:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578974336:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265494.006137:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265494.006148:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578974464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265494.006187:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1789265494.006188:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265494.006246:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578974464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265494.006253:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1789265494.006276:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789265494.006303:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775dc25500 x1876180578974464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265494.006322:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578974464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265494.008017:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578974336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1879us (2106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265494.008030:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1789265494.015662:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643586d80 x1876180578974336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265494.015691:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578974336:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789265494.579118:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265495.603199:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265496.635393:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265496.902340:0:13537:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:11:36 (1789265496) === 00000100:00100000:2.0:1789265497.088736:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578974976:0@lo:400:kworker.0 00000100:00100000:2.0:1789265497.088808:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265497.088854:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578975488:0@lo:400:kworker.0 00000100:00100000:2.0:1789265497.088906:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265497.088924:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578976000:0@lo:400:kworker.0 00000100:00100000:2.0:1789265497.088944:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265497.088972:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789265497.088978:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578974848:0@lo:400:kworker.0 00000100:00100000:2.0:1789265497.089000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265497.089016:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180578975360:0@lo:400:kworker.0 00000100:00100000:2.0:1789265497.089035:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265497.089049:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180578975872:0@lo:400:kworker.0 00000100:00100000:2.0:1789265497.089066:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265497.089131:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578974592:0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.089173:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265497.089207:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578975104:0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.089227:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265497.089244:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578975616:0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.089264:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265497.089284:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578976128:0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.089300:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265497.089317:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789265497.089322:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578974720:0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.089340:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265497.089356:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180578975232:0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.089374:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265497.089383:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180578975744:0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.089400:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265497.089430:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578974976 00000100:00100000:3.0:1789265497.089456:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578974976 00000100:00100000:3.0:1789265497.089493:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578975360 00000100:00100000:3.0:1789265497.089496:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578975360 00000100:00100000:3.0:1789265497.089519:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578975872 00000100:00100000:3.0:1789265497.089522:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578975872 00000100:00100000:3.0:1789265497.089534:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578974720 00000100:00100000:3.0:1789265497.089537:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578974720 00000100:00100000:3.0:1789265497.089547:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578975232 00000100:00100000:3.0:1789265497.089549:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578975232 00000100:00100000:3.0:1789265497.089559:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578975744 00000100:00100000:3.0:1789265497.089562:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578975744 00000100:00100000:3.0:1789265497.089575:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789265497.089584:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578974976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.089644:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578974976:12345-0@lo:400:kworker.0 Request processed in 60us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.089651:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789265497.089668:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789265497.089674:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180578975360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.089700:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180578975360:12345-0@lo:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.089706:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789265497.089716:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789265497.089722:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180578975872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.089746:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180578975872:12345-0@lo:400:kworker.0 Request processed in 24us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.089752:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789265497.089763:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789265497.089768:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578974720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.089800:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180578974720:12345-0@lo:400:kworker.0 Request processed in 32us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.089806:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789265497.089818:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789265497.089824:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180578975232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.089849:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180578975232:12345-0@lo:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.089960:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789265497.089982:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789265497.089989:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180578975744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.090025:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180578975744:12345-0@lo:400:kworker.0 Request processed in 37us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.090030:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789265497.090048:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578974848 00000100:00100000:3.0:1789265497.090052:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578974848 00000100:00100000:3.0:1789265497.090074:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578975104 00000100:00100000:3.0:1789265497.090076:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578975104 00000100:00100000:3.0:1789265497.090088:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789265497.090094:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578974848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.090124:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578974848:12345-0@lo:400:kworker.0 Request processed in 31us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.090129:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789265497.090139:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789265497.090144:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578975104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.090169:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578975104:12345-0@lo:400:kworker.0 Request processed in 24us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.090174:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789265497.090192:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578975488 00000100:00100000:3.0:1789265497.090196:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578975488 00000100:00100000:3.0:1789265497.090214:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578976000 00000100:00100000:3.0:1789265497.090216:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578976000 00000100:00100000:3.0:1789265497.090226:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578975616 00000100:00100000:3.0:1789265497.090229:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578975616 00000100:00100000:3.0:1789265497.090238:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578976128 00000100:00100000:3.0:1789265497.090241:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578976128 00000100:00100000:3.0:1789265497.090252:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789265497.090258:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578975488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.090287:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578975488:12345-0@lo:400:kworker.0 Request processed in 29us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.090300:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789265497.090312:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789265497.090317:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578976000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.090348:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578976000:12345-0@lo:400:kworker.0 Request processed in 31us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.090355:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789265497.090366:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789265497.090372:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578975616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.090397:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578975616:12345-0@lo:400:kworker.0 Request processed in 26us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.090402:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789265497.090413:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789265497.090418:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578976128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265497.091935:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578974592 00000100:00100000:2.0:1789265497.091949:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578974592 00000100:00100000:2.0:1789265497.092004:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789265497.092013:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3643:x1876180578974592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265497.094710:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578974848:0@lo:400:kworker.0 00010000:00080000:1.0:1789265497.094735:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376434d6d80 x1876180578975360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265497.094746:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180578975360:0@lo:400:kworker.0 00010000:00080000:1.0:1789265497.094760:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376434d5c00 x1876180578975872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265497.094769:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180578975872:0@lo:400:kworker.0 00000100:00100000:1.0:1789265497.094782:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578974976:0@lo:400:kworker.0 00010000:00080000:1.0:1789265497.094794:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376434d6300 x1876180578975488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265497.094801:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578975488:0@lo:400:kworker.0 00010000:00080000:1.0:1789265497.094813:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643641180 x1876180578976000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265497.094821:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578976000:0@lo:400:kworker.0 00000100:00080000:1.0:1789265497.094884:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265497.094890:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265497.094894:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265497.094897:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789265497.101031:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3643:x1876180578974592:12345-0@lo:400:kworker.0 Request processed in 9011us (11849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265497.101046:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789265497.108072:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578976128:12345-0@lo:400:kworker.0 Request processed in 17645us (18761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.108089:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789265497.108157:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180578974720:0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.108170:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180578975232:0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.108183:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180578975744:0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.108194:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578974592:0@lo:400:kworker.0 00000100:00100000:3.0:1789265497.108204:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578975104:0@lo:400:kworker.0 00010000:00080000:3.0:1789265497.108218:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376434d7b80 x1876180578975616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265497.108241:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578975616:0@lo:400:kworker.0 00010000:00080000:3.0:1789265497.108255:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643641f80 x1876180578976128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265497.108263:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578976128:0@lo:400:kworker.0 00000100:00100000:1.0:1789265497.289969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.290067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265497.290213:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556861824 00000100:00100000:3.0:1789265497.290224:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556861824 00000100:00100000:3.0:1789265497.290290:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:3.0:1789265497.290300:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2398:x1876180556861824:12345-192.168.202.42@tcp:41:mkdir.0 00000100:00100000:0.0:1789265497.290302:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556861952 00000100:00100000:0.0:1789265497.290309:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556861952 00000004:00000024:3.0:1789265497.290335:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789265497.290349:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:0.0:1789265497.290359:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:10506:x1876180556861952:12345-192.168.202.42@tcp:700:mkdir.0 00000100:00100000:3.0:1789265497.290421:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2398:x1876180556861824:12345-192.168.202.42@tcp:41:mkdir.0 Request processed in 123us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.290429:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00080000:3.0:1789265497.290668:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265497.293185:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:10506:x1876180556861952:12345-192.168.202.42@tcp:700:mkdir.0 Request processed in 2815us (3105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265497.293203:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:0.0:1789265497.295145:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.295229:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556862208 00000100:00100000:1.0:1789265497.295239:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556862208 00000100:00100000:1.0:1789265497.295352:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:1.0:1789265497.295363:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:10506:x1876180556862208:12345-192.168.202.42@tcp:36:mkdir.0 00010000:00010000:1.0:1789265497.295419:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265497.295621:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3a07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91904f expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.295642:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774e578f00) 00010000:00010000:1.0:1789265497.295651:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265497.295738:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d3b65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.295751:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d3b65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.295761:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d3b65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.295791:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d3b6c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.295798:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d3b6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.295806:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d3b6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.296663:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d3b73 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.296684:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d3b73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.296692:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d3b73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265497.296708:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034af04ff reply state 000000001d117b09 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d3b73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.296718:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d3b73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.296724:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93774f2ef300) 00010000:00010000:1.0:1789265497.296727:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265497.296730:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789265497.296735:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789265497.296741:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d3b65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.296748:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d3b65 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.296754:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d3b65 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.296760:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bde00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265497.296764:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d3b65 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.296771:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d3b65 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.296790:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774f2ef500) 00010000:00010000:1.0:1789265497.296792:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265497.296796:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d3b65 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.296801:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d3b65 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265497.296817:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034af04ff reply state 000000001d117b09 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d3b6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.296825:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d3b6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.296831:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93774f2efa00) 00010000:00010000:1.0:1789265497.296833:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265497.296835:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789265497.296943:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:10506:x1876180556862208:12345-192.168.202.42@tcp:36:mkdir.0 Request processed in 1580us (1869us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789265497.296953:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:1.0:1789265497.305023:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265497.305224:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556862336 00000100:00100000:2.0:1789265497.305236:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556862336 00000100:00100000:2.0:1789265497.305307:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:2.0:1789265497.305319:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+7:10507:x1876180556862336:12345-192.168.202.42@tcp:101:chmod.0 00010000:00010000:2.0:1789265497.305354:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265497.305380:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd200/0xbbfdc9019c1d3b7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9190e2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.305461:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3b81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.305474:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3b81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.305487:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3b81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265497.305538:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789265497.305542:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265497.305591:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3b81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.305617:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd200/0xbbfdc9019c1d3b7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190e2 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.305636:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3b81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190e2 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.305643:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774f0ea300) 00010000:00010000:2.0:1789265497.305646:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265497.305649:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fca00, rc 0) 00000100:00100000:2.0:1789265497.305810:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+8:10507:x1876180556862336:12345-192.168.202.42@tcp:101:chmod.0 Request processed in 493us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265497.305817:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:0.0:1789265497.311219:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265497.311373:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556862592 00000100:00100000:2.0:1789265497.311384:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556862592 00000100:00100000:2.0:1789265497.311491:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:2.0:1789265497.311503:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+8:10507:x1876180556862592:12345-192.168.202.42@tcp:36:chmod.0 00010000:00010000:2.0:1789265497.311561:0:9988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265497.311591:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3b81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190e2 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.311611:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774f0ea300) 00010000:00010000:2.0:1789265497.311622:0:9988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265497.311642:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3b88 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.311652:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3b88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.311660:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3b88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265497.311845:0:9988:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096ed1399 reply state 00000000f2495c2f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3b88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.311856:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3b88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.313126:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774f0eae00) 00010000:00010000:2.0:1789265497.313130:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789265497.313134:0:9988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789265497.313147:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789265497.313258:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+9:10507:x1876180556862592:12345-192.168.202.42@tcp:36:chmod.0 Request processed in 1755us (2049us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789265497.313283:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:0.0:1789265497.343934:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265497.344181:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556862720 00000100:00100000:3.0:1789265497.344192:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556862720 00000100:00100000:3.0:1789265497.344252:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:3.0:1789265497.344263:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+9:10508:x1876180556862720:12345-192.168.202.42@tcp:101:chown.0 00010000:00010000:3.0:1789265497.344295:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265497.344315:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3b8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9190e9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.344378:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d3b96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.344391:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d3b96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.344418:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d3b96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265497.344483:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265497.344487:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265497.344526:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d3b96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.344554:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3b8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190e9 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.344573:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d3b96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190e9 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.344582:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774f0eae00) 00010000:00010000:3.0:1789265497.344585:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265497.344590:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643218200, rc 0) 00000100:00100000:3.0:1789265497.344654:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+10:10508:x1876180556862720:12345-192.168.202.42@tcp:101:chown.0 Request processed in 393us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.344661:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:3.0:1789265497.350664:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.350851:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556862848 00000100:00100000:1.0:1789265497.350897:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556862848 00000100:00100000:1.0:1789265497.350962:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:1.0:1789265497.350974:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+10:10508:x1876180556862848:12345-192.168.202.42@tcp:101:chown.0 00010000:00010000:1.0:1789265497.350997:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265497.351017:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d3b9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9190f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351115:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d3ba4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351131:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d3ba4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351142:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d3ba4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351152:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d3bab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351159:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d3bab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351165:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d3bab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351241:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3bb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351252:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351260:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265497.351309:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789265497.351313:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265497.351332:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351355:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d3ba4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351361:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d3ba4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351367:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d3ba4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351372:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bcc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265497.351376:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d3ba4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351383:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d3ba4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351396:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774f0eae00) 00010000:00010000:1.0:1789265497.351399:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265497.351404:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d3ba4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351409:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d3ba4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351422:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d3bab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351428:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d3bab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351513:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d3bab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351525:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265497.351528:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d3bab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351534:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d3bab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351543:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93774f2efa00) 00010000:00010000:1.0:1789265497.351545:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265497.351548:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d3bab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351554:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d3bab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351593:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d3b9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190f0 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351608:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190f0 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.351615:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93774f2ef300) 00010000:00010000:1.0:1789265497.351617:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265497.351620:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740030e00, rc 0) 00000100:00100000:1.0:1789265497.351680:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+11:10508:x1876180556862848:12345-192.168.202.42@tcp:101:chown.0 Request processed in 708us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265497.351688:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:0.0:1789265497.361905:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265497.362043:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556862976 00000100:00100000:2.0:1789265497.362053:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556862976 00000100:00100000:2.0:1789265497.362118:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:2.0:1789265497.362128:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f16c02c5-6a63-4180-875a-2aaaca684c23+11:10508:x1876180556862976:12345-192.168.202.42@tcp:900:chown.0 00000100:00100000:2.0:1789265497.362217:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f16c02c5-6a63-4180-875a-2aaaca684c23+11:10508:x1876180556862976:12345-192.168.202.42@tcp:900:chown.0 Request processed in 90us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265497.362225:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:0.0:1789265497.365542:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265497.365730:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556863232 00000100:00100000:3.0:1789265497.365741:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556863232 00000100:00100000:3.0:1789265497.365806:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:3.0:1789265497.365817:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+11:10508:x1876180556863232:12345-192.168.202.42@tcp:36:chown.0 00010000:00010000:3.0:1789265497.365934:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265497.365969:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3bb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190f0 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.366008:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93774f2ef300) 00010000:00010000:3.0:1789265497.366013:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265497.366038:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3bb9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.366052:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3bb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.366062:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3bb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265497.369451:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1789265497.369633:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d3b6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369647:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d3b6c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369655:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d3b6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369662:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bda00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265497.369666:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d3b6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369674:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d3b6c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369691:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93774f2efa00) 00010000:00010000:3.0:1789265497.369694:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265497.369700:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d3b6c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369714:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d3b6c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369739:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d3b73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369746:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d3b73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369752:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d3b73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369756:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265497.369759:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d3b73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369765:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d3b73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369772:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93774f2ef300) 00010000:00010000:3.0:1789265497.369775:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265497.369778:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d3b73 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369783:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d3b73 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369797:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3b88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369803:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3b88 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369815:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3b88 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369819:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265497.369822:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3b88 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369828:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3b88 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369836:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774f0eae00) 00010000:00010000:3.0:1789265497.369838:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789265497.369841:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3b88 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.369847:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3b88 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265497.373115:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a10d15da reply state 00000000ec86fef0 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3bb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.373139:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3bb9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.373149:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93774f2ef300) 00010000:00010000:2.0:1789265497.373152:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789265497.373155:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789265497.373171:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1789265497.373390:0:6521:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789265497.373414:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+7:10508:x1876180556863232:12345-192.168.202.42@tcp:36:chown.0 Request processed in 7594us (7876us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789265497.373422:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00010000:00010000:3.0:1789265497.373610:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3bb9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.373620:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3bb9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.373626:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3bb9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.373631:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643219c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265497.373635:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3bb9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.373657:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3bb9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.373669:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93774f2ef300) 00010000:00010000:3.0:1789265497.373672:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789265497.373676:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3bb9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.373682:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3bb9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265497.394828:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.395000:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556863360 00000100:00100000:1.0:1789265497.395012:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556863360 00000100:00100000:1.0:1789265497.395073:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:1.0:1789265497.395085:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:10509:x1876180556863360:12345-192.168.202.42@tcp:101:touch.500 00010000:00010000:1.0:1789265497.395107:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265497.395148:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3bc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9190f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265497.396560:0:6520:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1357us 00010000:00010000:1.0:1789265497.417591:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3bc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417616:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3bc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417630:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3bc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417646:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d3bce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417652:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d3bce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417658:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d3bce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417790:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3bd5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417799:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417817:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265497.417847:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789265497.417851:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265497.417917:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417929:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3bc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417935:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3bc7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417941:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417945:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265497.417949:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417957:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3bc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417970:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774f0eae00) 00010000:00010000:1.0:1789265497.417972:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265497.417977:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3bc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.417983:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3bc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.418006:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d3bce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.418012:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d3bce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.418018:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d3bce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.418023:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265497.418026:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d3bce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.418032:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d3bce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.418040:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9377446e4f00) 00010000:00010000:1.0:1789265497.418042:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265497.418045:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d3bce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.418050:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d3bce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.418090:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3bc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190f7 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.418106:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190f7 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.418123:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9377446e4a00) 00010000:00010000:1.0:1789265497.418126:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789265497.418129:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740030800, rc 0) 00000100:00100000:1.0:1789265497.418198:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:10509:x1876180556863360:12345-192.168.202.42@tcp:101:touch.500 Request processed in 23114us (23379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265497.418207:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:1.0:1789265497.423160:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265497.423352:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556863616 00000100:00100000:3.0:1789265497.423363:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556863616 00000100:00100000:3.0:1789265497.423462:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:3.0:1789265497.423473:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+7:10509:x1876180556863616:12345-192.168.202.42@tcp:101:touch.500 00010000:00010000:3.0:1789265497.423493:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265497.423513:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3bdc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9190fe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.423618:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219400/0xbbfdc9019c1d3be3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.423632:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643219400/0xbbfdc9019c1d3be3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.423643:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643219400/0xbbfdc9019c1d3be3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.423671:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219600/0xbbfdc9019c1d3bea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.423678:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643219600/0xbbfdc9019c1d3bea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.423685:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643219600/0xbbfdc9019c1d3bea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265497.424077:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789265497.424213:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d3bf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.424221:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d3bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.424229:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d3bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.424258:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219400/0xbbfdc9019c1d3be3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.424266:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643219400/0xbbfdc9019c1d3be3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.424273:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937643219400/0xbbfdc9019c1d3be3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.424279:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643219400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265497.424283:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643219400/0xbbfdc9019c1d3be3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.424300:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643219400/0xbbfdc9019c1d3be3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.424313:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9377446e4a00) 00010000:00010000:3.0:1789265497.424316:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265497.424321:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937643219400/0xbbfdc9019c1d3be3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.424327:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219400/0xbbfdc9019c1d3be3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265497.424343:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006700d08e reply state 000000009b8db09e transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff937643219600/0xbbfdc9019c1d3bea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.424354:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643219600/0xbbfdc9019c1d3bea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.424360:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x22313a05 (ffff93774e575200) 00010000:00010000:3.0:1789265497.424363:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265497.424365:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789265497.424393:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3bdc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190fe expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.424405:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d3bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190fe expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.424412:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93774e575500) 00010000:00010000:3.0:1789265497.424414:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265497.424416:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219a00, rc 0) 00000100:00100000:3.0:1789265497.424489:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+10:10509:x1876180556863616:12345-192.168.202.42@tcp:101:touch.500 Request processed in 1017us (1340us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789265497.424502:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:0.0:1789265497.429777:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265497.429896:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556863872 00000100:00100000:2.0:1789265497.429908:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556863872 00000100:00100000:2.0:1789265497.429964:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:2.0:1789265497.429974:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+10:10509:x1876180556863872:12345-192.168.202.42@tcp:36:touch.500 00010000:00010000:2.0:1789265497.430031:0:9988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265497.430071:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d3bf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190fe expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.430092:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93774e575500) 00010000:00010000:2.0:1789265497.430102:0:9988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265497.430163:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3bff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.430178:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3bff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.430187:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3bff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265497.430295:0:9988:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae9db366 reply state 00000000b7ce9d4a transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3bff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.430307:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3bff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.430313:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93774f0ea300) 00010000:00010000:2.0:1789265497.430316:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265497.430318:0:9988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265497.430407:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+11:10509:x1876180556863872:12345-192.168.202.42@tcp:36:touch.500 Request processed in 433us (639us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789265497.430414:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:1.0:1789265497.433855:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265497.434052:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556864000 00000100:00100000:2.0:1789265497.434062:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556864000 00000100:00100000:2.0:1789265497.434121:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00100000:2.0:1789265497.434132:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+11:10509:x1876180556864000:12345-192.168.202.42@tcp:101:touch.500 00010000:00010000:2.0:1789265497.434173:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265497.434193:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd200/0xbbfdc9019c1d3c06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919105 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.434247:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd200/0xbbfdc9019c1d3c06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919105 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.434273:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd200/0xbbfdc9019c1d3c06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919105 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.434292:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93774f0ea300) 00010000:00010000:2.0:1789265497.434295:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265497.434298:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd200, rc 0) 00000100:00100000:2.0:1789265497.434362:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+12:10509:x1876180556864000:12345-192.168.202.42@tcp:101:touch.500 Request processed in 231us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265497.434369:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00100000:0.0:1789265497.438609:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.438690:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556864128 00000100:00100000:1.0:1789265497.438700:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556864128 00000100:00100000:1.0:1789265497.438747:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:1.0:1789265497.438755:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1876180556864128:12345-192.168.202.42@tcp:8:touch.500 00010000:00080000:1.0:1789265497.438791:0:9789:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp t0 exp 0000000000000000 cur 353 last 0 00000020:00000080:1.0:1789265497.438823:0:9789:0:(genops.c:1385:class_connect()) connect: client f16c02c5-6a63-4180-875a-2aaaca684c23, cookie 0xbbfdc9019c1d3c0d 00002000:00100000:1.0:1789265497.438835:0:9789:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f16c02c5-6a63-4180-875a-2aaaca684c23/ffff93777f36f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789265497.438854:0:9789:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:1.0:1789265497.438967:0:9789:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789265497.438996:0:9789:0:(import.c:65:import_set_state_nolock()) ffff93777f369000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265497.439067:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2396:x1876180556864128:12345-192.168.202.42@tcp:8:touch.500 Request processed in 311us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265497.439074:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:0.0:1789265497.442089:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.442219:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556864256 00000100:00100000:1.0:1789265497.442229:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556864256 00000100:00100000:1.0:1789265497.442318:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:1.0:1789265497.442328:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:0:x1876180556864256:12345-192.168.202.42@tcp:2:touch.500 00000100:00080000:3.0:1789265497.442691:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789265497.450658:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:3.0:1789265497.450676:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f16c02c5-6a63-4180-875a-2aaaca684c23 00000100:00100000:1.0:1789265497.450947:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:0:x1876180556864256:12345-192.168.202.42@tcp:2:touch.500 Request processed in 8612us (8859us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789265497.450960:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:3.0:1789265497.454056:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265497.454189:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556864512 00000100:00100000:0.0:1789265497.454200:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556864512 00000100:00100000:0.0:1789265497.454323:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:0.0:1789265497.454333:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+12:10509:x1876180556864512:12345-192.168.202.42@tcp:35:touch.500 00000100:00100000:0.0:1789265497.454677:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+13:10509:x1876180556864512:12345-192.168.202.42@tcp:35:touch.500 Request processed in 344us (630us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789265497.454684:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:0.0:1789265497.472450:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265497.472597:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556864640 00000100:00100000:2.0:1789265497.472608:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556864640 00000100:00100000:2.0:1789265497.472668:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:2.0:1789265497.472679:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+13:10510:x1876180556864640:12345-192.168.202.42@tcp:101:rm.0 00010000:00010000:2.0:1789265497.472704:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265497.472724:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd000/0xbbfdc9019c1d3c14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91910c expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.472787:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3c1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.472801:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3c1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.472825:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3c1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265497.472910:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789265497.472914:0:9988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265497.472952:0:9988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3c1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.472979:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd000/0xbbfdc9019c1d3c14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91910c expref: 15 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.472998:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3c1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91910c expref: 14 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.473006:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9377446e4a00) 00010000:00010000:2.0:1789265497.473008:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265497.473011:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc000, rc 0) 00000100:00100000:2.0:1789265497.473076:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+14:10510:x1876180556864640:12345-192.168.202.42@tcp:101:rm.0 Request processed in 399us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265497.473084:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:2.0:1789265497.483748:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265497.483838:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556864896 00000100:00100000:3.0:1789265497.483850:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556864896 00000100:00100000:3.0:1789265497.483936:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:3.0:1789265497.483946:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+14:10510:x1876180556864896:12345-192.168.202.42@tcp:101:rm.0 00010000:00010000:3.0:1789265497.483966:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265497.483987:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3c22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919113 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265497.484086:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789265497.484233:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3c22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919113 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.484248:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774f0eae00) 00010000:00010000:3.0:1789265497.484251:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265497.484255:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219c00/0xbbfdc9019c1d3c22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919113 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265497.484282:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219c00, rc 0) 00000100:00100000:3.0:1789265497.484339:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+15:10510:x1876180556864896:12345-192.168.202.42@tcp:101:rm.0 Request processed in 396us (601us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1789265497.484346:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:3.0:1789265497.494963:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.495077:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556865024 00000100:00100000:1.0:1789265497.495087:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556865024 00000100:00100000:1.0:1789265497.495138:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:1.0:1789265497.495148:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+15:10510:x1876180556865024:12345-192.168.202.42@tcp:37:rm.0 00000100:00100000:1.0:1789265497.500567:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+15:10510:x1876180556865024:12345-192.168.202.42@tcp:37:rm.0 Request processed in 5409us (5606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265497.500581:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:2.0:1789265497.510261:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265497.510371:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556865280 00000100:00100000:0.0:1789265497.510383:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556865280 00000100:00100000:0.0:1789265497.510466:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:0.0:1789265497.510477:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779d32850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+15:10510:x1876180556865280:12345-192.168.202.42@tcp:35:rm.0 00000100:00100000:0.0:1789265497.510728:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779d32850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+16:10510:x1876180556865280:12345-192.168.202.42@tcp:35:rm.0 Request processed in 251us (476us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789265497.510736:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:3.0:1789265497.514671:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265497.515726:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556865536 00000100:00100000:2.0:1789265497.515741:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556865536 00000100:00100000:2.0:1789265497.515856:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:2.0:1789265497.515884:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+16:10510:x1876180556865536:12345-192.168.202.42@tcp:101:rm.0 00010000:00010000:2.0:1789265497.515909:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265497.515943:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3c30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91911a expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.516050:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd000/0xbbfdc9019c1d3c37 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.516064:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd000/0xbbfdc9019c1d3c37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.516086:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd000/0xbbfdc9019c1d3c37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265497.516099:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789265497.516203:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3c30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91911a expref: 19 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.516224:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd000/0xbbfdc9019c1d3c37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91911a expref: 18 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.516233:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9377446e4a00) 00010000:00010000:2.0:1789265497.516237:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265497.516240:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd000, rc 0) 00000100:00100000:2.0:1789265497.516318:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+18:10510:x1876180556865536:12345-192.168.202.42@tcp:101:rm.0 Request processed in 436us (1656us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789265497.516326:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:0.0:1789265497.520073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265497.520225:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556865664 00000100:00100000:3.0:1789265497.520236:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556865664 00000100:00100000:3.0:1789265497.520295:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:3.0:1789265497.520304:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+18:10510:x1876180556865664:12345-192.168.202.42@tcp:41:rm.0 00000004:00000024:3.0:1789265497.520349:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1789265497.520417:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+18:10510:x1876180556865664:12345-192.168.202.42@tcp:41:rm.0 Request processed in 113us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.520425:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:0.0:1789265497.522854:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.522986:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556865792 00000100:00100000:1.0:1789265497.522995:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556865792 00000100:00100000:1.0:1789265497.523044:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:1.0:1789265497.523054:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+18:10510:x1876180556865792:12345-192.168.202.42@tcp:101:rm.0 00010000:00010000:1.0:1789265497.523071:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265497.523090:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d3c45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523150:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c4c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523162:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523173:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523184:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523205:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523212:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523300:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3c5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523306:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3c5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523311:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3c5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265497.523340:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789265497.523344:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265497.523357:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3c5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523365:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3c5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523370:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523374:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c4c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523379:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523390:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265497.523393:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523398:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c4c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523407:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9377446e4a00) 00010000:00010000:1.0:1789265497.523409:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265497.523411:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523415:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523424:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523427:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523536:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523544:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265497.523547:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523554:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523572:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x22313a05 (ffff93774e575200) 00010000:00010000:1.0:1789265497.523575:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265497.523578:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523584:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523611:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d3c45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919121 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523624:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3c5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919121 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.523630:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93774f0ea300) 00010000:00010000:1.0:1789265497.523632:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265497.523634:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740031600, rc 0) 00000100:00100000:1.0:1789265497.523698:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+19:10510:x1876180556865792:12345-192.168.202.42@tcp:101:rm.0 Request processed in 640us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265497.523705:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:1.0:1789265497.527615:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265497.528781:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556866048 00000100:00100000:2.0:1789265497.528795:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556866048 00000100:00100000:2.0:1789265497.528847:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:2.0:1789265497.529000:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+19:10510:x1876180556866048:12345-192.168.202.42@tcp:36:rm.0 00010000:00010000:2.0:1789265497.529081:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789265497.529109:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3c5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919121 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.529133:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd200/0xbbfdc9019c1d3c06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919105 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.529145:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93774f0ea300) 00010000:00010000:2.0:1789265497.529155:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3c1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91910c expref: 17 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.529164:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9377446e4a00) 00010000:00010000:2.0:1789265497.529167:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265497.529187:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3c61 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.529200:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3c61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.529209:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3c61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.529219:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3c68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.529227:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3c68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.529233:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3c68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.529373:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3c6f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.529381:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3c6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.529387:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3c6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265497.530090:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789265497.530101:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353191241195ns, next at 354191238602ns, rc = 0 00010000:00010000:2.0:1789265497.530150:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fce00/0xbbfdc9019c1d3c76 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530160:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fce00/0xbbfdc9019c1d3c76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530169:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fce00/0xbbfdc9019c1d3c76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530177:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fce00/0xbbfdc9019c1d3c76 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530183:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fce00/0xbbfdc9019c1d3c76 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530189:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fce00/0xbbfdc9019c1d3c76 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530251:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265497.530277:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3c6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530294:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3c6f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530300:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3c6f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530306:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fde00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265497.530310:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3c6f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530316:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3c6f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530325:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93774f0ea300) 00010000:00010000:2.0:1789265497.530328:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789265497.530331:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3c6f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530338:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3c6f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530355:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3c61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530361:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3c61 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530367:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3c61 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530372:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fdc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265497.530381:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3c61 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530387:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3c61 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530395:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9377446e4a00) 00010000:00010000:2.0:1789265497.530398:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265497.530400:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3c61 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530406:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3c61 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265497.530416:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000806e13e5 reply state 00000000c6d5afb1 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3c68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530425:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3c68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265497.530431:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x22313a05 (ffff93774e575200) 00010000:00010000:2.0:1789265497.530433:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265497.530448:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265497.530585:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+18:10510:x1876180556866048:12345-192.168.202.42@tcp:36:rm.0 Request processed in 1727us (2978us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789265497.530593:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 38 00010000:00010000:1.0:1789265497.531425:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265497.531535:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fce00/0xbbfdc9019c1d3c76 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.531543:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fce00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265497.531546:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fce00/0xbbfdc9019c1d3c76 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.531640:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fce00/0xbbfdc9019c1d3c76 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.531654:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93774f0ea300) 00010000:00010000:1.0:1789265497.531657:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789265497.531660:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fce00/0xbbfdc9019c1d3c76 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.531665:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fce00/0xbbfdc9019c1d3c76 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.531680:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265497.531682:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265497.531684:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265497.538432:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265497.538629:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556866304 00000100:00100000:3.0:1789265497.538639:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556866304 00000100:00100000:3.0:1789265497.538696:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:3.0:1789265497.538706:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+18:10510:x1876180556866304:12345-192.168.202.42@tcp:35:rm.0 00000100:00100000:2.0:1789265497.539229:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+19:10510:x1876180556866304:12345-192.168.202.42@tcp:35:rm.0 Request processed in 521us (803us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789265497.539241:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:0.0:1789265497.543944:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.544022:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556866560 00000100:00100000:1.0:1789265497.544032:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556866560 00000100:00100000:1.0:1789265497.544094:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:1.0:1789265497.544104:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+19:10510:x1876180556866560:12345-192.168.202.42@tcp:36:rm.0 00010000:00010000:1.0:1789265497.544158:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789265497.544185:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd000/0xbbfdc9019c1d3c37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91911a expref: 19 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.544205:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3bd5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190f7 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.544217:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9377446e4a00) 00010000:00010000:1.0:1789265497.544234:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d3b96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190e9 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.544273:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774f0eae00) 00010000:00010000:1.0:1789265497.544283:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265497.544305:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c7d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.544317:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.544327:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.544348:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c84 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.544355:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.544362:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.544458:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3c8b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.544467:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3c8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.544473:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3c8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265497.545019:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789265497.545035:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3c8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545050:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3c8b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545056:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3c8b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545062:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265497.545066:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3c8b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545074:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3c8b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545084:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9377446e4c00) 00010000:00010000:1.0:1789265497.545086:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789265497.545090:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3c8b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545096:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3c8b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545115:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545121:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c7d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545127:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c7d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545131:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265497.545140:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c7d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545147:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c7d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545155:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9377446e4f00) 00010000:00010000:1.0:1789265497.545157:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265497.545160:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c7d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545166:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3c7d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265497.545178:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000991ef2c3 reply state 00000000151fa56a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545189:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265497.545196:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9377446e4600) 00010000:00010000:1.0:1789265497.545198:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265497.545201:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265497.545273:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+18:10510:x1876180556866560:12345-192.168.202.42@tcp:36:rm.0 Request processed in 1169us (1337us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789265497.545281:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:0.0:1789265497.587991:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578976256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265497.588083:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265497.588220:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578976256 00000100:00100000:1.0:1789265497.588229:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578976256 00000100:00100000:1.0:1789265497.588297:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789265497.588308:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578976256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265497.588332:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265497.588396:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578976256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265497.588403:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:0.0:1789265497.588754:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376434d5180 x1876180578976256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265497.588775:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578976256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265497.596389:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265497.596415:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578976384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265497.596512:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265497.596933:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578976384 00000100:00100000:2.0:1789265497.596942:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578976384 00000100:00100000:2.0:1789265497.597012:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789265497.597035:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578976384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265497.597063:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265497.597125:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578976384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265497.597132:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1789265497.597403:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642752680 x1876180578976384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265497.597427:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578976384:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789265497.652329:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265497.853296:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.853342:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.853371:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.853401:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.853446:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.853473:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265497.853500:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556867072 00000100:00100000:1.0:1789265497.853510:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556867072 00000100:00100000:1.0:1789265497.853564:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 107 00000100:00100000:1.0:1789265497.853574:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556867072:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265497.853639:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556867072:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 67us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265497.853647:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 107 00000100:00100000:1.0:1789265497.853669:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556866944 00000100:00100000:1.0:1789265497.853673:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556866944 00000100:00100000:1.0:1789265497.853696:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556867200 00000100:00100000:1.0:1789265497.853698:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556867200 00000100:00100000:1.0:1789265497.853710:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556866816 00000100:00100000:1.0:1789265497.853714:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556866816 00000100:00100000:1.0:1789265497.853722:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556867328 00000100:00100000:1.0:1789265497.853724:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556867328 00000100:00100000:1.0:1789265497.853735:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 219 00000100:00100000:1.0:1789265497.853741:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556866944:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265497.853784:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556866944:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 42us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265497.853791:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 219 00000100:00100000:1.0:1789265497.853804:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 220 00000100:00100000:1.0:1789265497.853810:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556867200:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265497.853832:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556867200:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265497.853838:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 220 00000100:00100000:1.0:1789265497.853851:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 221 00000100:00100000:1.0:1789265497.853857:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+18:2399:x1876180556866816:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265497.853924:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+18:2399:x1876180556866816:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 67us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265497.853930:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 221 00000100:00100000:1.0:1789265497.853942:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 222 00000100:00100000:1.0:1789265497.853947:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556867328:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265497.853971:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556867328:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265497.853976:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 222 00000100:00100000:3.0:1789265497.854666:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556866688 00000100:00100000:3.0:1789265497.854673:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556866688 00000100:00100000:3.0:1789265497.854714:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 340 00000100:00100000:3.0:1789265497.854721:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:2399:x1876180556866688:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265497.854767:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:2399:x1876180556866688:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 46us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265497.854774:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 340 00000100:00080000:3.0:1789265497.854805:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265497.854817:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265498.611420:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578976512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265498.611512:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265498.611594:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578976512 00000100:00100000:3.0:1789265498.611603:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578976512 00000100:00100000:3.0:1789265498.611656:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789265498.611666:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578976512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265498.611707:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265498.611762:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578976512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265498.611769:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789265498.611836:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578976512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265498.617173:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265498.617198:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578976640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265498.617273:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265498.617524:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578976640 00000100:00100000:1.0:1789265498.617533:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578976640 00000100:00100000:1.0:1789265498.617597:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789265498.617609:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578976640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265498.617646:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265498.617724:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578976640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265498.617732:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789265498.617847:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578976640:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789265498.676735:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265499.124440:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265499.124466:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578976768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265499.124536:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265499.124615:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578976768 00000100:00100000:2.0:1789265499.124623:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578976768 00000100:00100000:2.0:1789265499.124680:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789265499.124691:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578976768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265499.124719:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265499.124764:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578976768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265499.124771:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1789265499.124790:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265499.124818:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643643800 x1876180578976768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265499.124835:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578976768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265499.127082:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265499.127105:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578976896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265499.127167:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265499.127219:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578976896 00000100:00100000:0.0:1789265499.127226:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578976896 00000100:00100000:0.0:1789265499.127280:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789265499.127288:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578976896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265499.127317:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265499.127358:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578976896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265499.127366:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1789265499.127387:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265499.127411:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f423b80 x1876180578976896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265499.127440:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578976896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789265499.699125:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265500.723505:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265501.747058:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789265501.962591:0:13685:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1789265502.195494:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578977280:0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.195578:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265502.195663:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578977792:0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.195689:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265502.195707:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764362b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180578978304:0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.195750:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265502.195779:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789265502.195786:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578977152:0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.195808:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265502.195831:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764362ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578977664:0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.195851:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265502.195902:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764362b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578978176:0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.195932:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265502.195965:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578977280 00000100:00100000:3.0:1789265502.195972:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578977280 00000100:00100000:3.0:1789265502.196019:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789265502.196029:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578977280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.196082:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578977280:12345-0@lo:400:kworker.0 Request processed in 54us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.196089:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789265502.196111:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578977792 00000100:00100000:3.0:1789265502.196115:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578977792 00000100:00100000:3.0:1789265502.196143:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578978304 00000100:00100000:3.0:1789265502.196146:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578978304 00000100:00100000:3.0:1789265502.196159:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578977152 00000100:00100000:3.0:1789265502.196161:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578977152 00000100:00100000:3.0:1789265502.196170:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578977664 00000100:00100000:3.0:1789265502.196172:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578977664 00000100:00100000:3.0:1789265502.196182:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578978176 00000100:00100000:3.0:1789265502.196184:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578978176 00000100:00100000:3.0:1789265502.196196:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789265502.196202:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578977792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.196234:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578977792:12345-0@lo:400:kworker.0 Request processed in 31us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.196240:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789265502.196252:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789265502.196258:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180578978304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.196280:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180578978304:12345-0@lo:400:kworker.0 Request processed in 24us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.196286:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789265502.196304:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789265502.196310:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578977152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.196336:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578977152:12345-0@lo:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.196342:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789265502.196353:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789265502.196358:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578977664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.196384:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578977664:12345-0@lo:400:kworker.0 Request processed in 26us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.196389:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789265502.196413:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789265502.196419:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578978176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.196444:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578978176:12345-0@lo:400:kworker.0 Request processed in 26us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.196449:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:3.0:1789265502.196477:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265502.196481:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265502.196507:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578977152:0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.196518:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764362ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578977664:0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.196527:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764362b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578978176:0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.196535:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578977280:0@lo:400:kworker.0 00010000:00080000:3.0:1789265502.196547:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643628700 x1876180578977792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265502.196557:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578977792:0@lo:400:kworker.0 00010000:00080000:3.0:1789265502.196575:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764362b800 x1876180578978304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265502.196584:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764362b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180578978304:0@lo:400:kworker.0 00000100:00100000:1.0:1789265502.197032:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578977408:0@lo:400:kworker.0 00000100:00100000:1.0:1789265502.197068:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265502.197087:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578977920:0@lo:400:kworker.0 00000100:00100000:1.0:1789265502.197109:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265502.197126:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578978432:0@lo:400:kworker.0 00000100:00100000:1.0:1789265502.197145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265502.197164:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789265502.197171:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578977024:0@lo:400:kworker.0 00000100:00100000:1.0:1789265502.197198:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265502.197222:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578977536:0@lo:400:kworker.0 00000100:00100000:1.0:1789265502.197243:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265502.197257:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764362a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578978048:0@lo:400:kworker.0 00000100:00100000:1.0:1789265502.197273:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265502.197289:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e6ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578978560:0@lo:400:kworker.0 00000100:00100000:1.0:1789265502.197306:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265502.197329:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578977920 00000100:00100000:1.0:1789265502.197334:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578977920 00000100:00100000:1.0:1789265502.197361:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578978432 00000100:00100000:1.0:1789265502.197364:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578978432 00000100:00100000:1.0:1789265502.197373:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578978048 00000100:00100000:1.0:1789265502.197375:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578978048 00000100:00100000:1.0:1789265502.197384:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578978560 00000100:00100000:2.0:1789265502.197482:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578977024 00000100:00100000:2.0:1789265502.197486:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578977024 00000100:00100000:2.0:1789265502.197510:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789265502.197516:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578977024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265502.197555:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578977024:12345-0@lo:400:kworker.0 Request processed in 39us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265502.197568:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789265502.197602:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578977536 00000100:00100000:2.0:1789265502.197605:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578977536 00000100:00100000:2.0:1789265502.197629:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789265502.197634:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578977536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265502.197671:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578977536:12345-0@lo:400:kworker.0 Request processed in 37us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265502.197678:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789265502.197694:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789265502.197701:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578977920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265502.197724:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578977920:12345-0@lo:400:kworker.0 Request processed in 24us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265502.197729:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789265502.197741:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789265502.197746:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578978432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265502.197765:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578978432:12345-0@lo:400:kworker.0 Request processed in 19us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265502.197770:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789265502.197778:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789265502.197784:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578978048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265502.197804:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578978048:12345-0@lo:400:kworker.0 Request processed in 21us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265502.197809:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789265502.197836:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578977024:0@lo:400:kworker.0 00000100:00100000:2.0:1789265502.197855:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578977536:0@lo:400:kworker.0 00010000:00080000:2.0:1789265502.197886:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764362a680 x1876180578978048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265502.197896:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764362a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578978048:0@lo:400:kworker.0 00010000:00080000:2.0:1789265502.197905:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643628000 x1876180578977920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265502.197913:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578977920:0@lo:400:kworker.0 00010000:00080000:2.0:1789265502.197921:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e6fd500 x1876180578978432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265502.197928:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578978432:0@lo:400:kworker.0 00000100:00100000:1.0:1789265502.198300:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578978560 00000100:00100000:1.0:1789265502.198334:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789265502.198341:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578978560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265502.198380:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578978560:12345-0@lo:400:kworker.0 Request processed in 40us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265502.198386:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1789265502.198589:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e6ff800 x1876180578978560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265502.198600:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e6ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578978560:0@lo:400:kworker.0 00000100:00080000:3.0:1789265502.199207:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265502.199213:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265502.199227:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578977408 00000100:00100000:3.0:1789265502.199232:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578977408 00000100:00100000:3.0:1789265502.199306:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789265502.199314:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578977408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265502.199371:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578977408:12345-0@lo:400:kworker.0 Request processed in 59us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.199378:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789265502.199445:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578977408:0@lo:400:kworker.0 00000004:00080000:0.0:1789265502.708058:0:9785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358369193716ns, next at 359369188646ns, rc = 0 00000100:00100000:0.0:1789265502.708117:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578978688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265502.708296:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265502.708708:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578978688 00000100:00100000:1.0:1789265502.708717:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578978688 00000100:00100000:1.0:1789265502.708787:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789265502.708799:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578978688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265502.708841:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265502.708929:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578978688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265502.708938:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789265502.708967:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578978816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265502.708999:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265502.709041:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578978816 00000100:00100000:1.0:1789265502.709046:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578978816 00000100:00100000:1.0:1789265502.709069:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789265502.709075:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578978816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265502.709085:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265502.709115:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578978816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265502.709121:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1789265502.709176:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f423b80 x1876180578978688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265502.709199:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578978688:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789265502.709247:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435ed880 x1876180578978816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265502.709258:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578978816:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1789265502.730591:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1789265502.730712:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1789265502.730728:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789265502.733057:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265502.733090:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578978944:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789265502.733184:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265502.733277:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578978944 00000100:00100000:1.0:1789265502.733285:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578978944 00000100:00100000:1.0:1789265502.733342:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789265502.733352:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578978944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789265502.733385:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1789265502.733447:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa6065a, atime: 0x6aa6065a, ctime: 0x6aa6065a, blocks: 0x0 00010000:00010000:1.0:1789265502.733456:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9dd771/0xbbfdc9019c1d3c92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.733478:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1789265502.733483:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265502.733491:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9dd771/0xbbfdc9019c1d3c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733741:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219600/0xbbfdc9019c1d3bea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733752:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643219600/0xbbfdc9019c1d3bea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733759:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937643219600/0xbbfdc9019c1d3bea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733766:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643219600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265502.733771:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643219600/0xbbfdc9019c1d3bea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733798:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643219600/0xbbfdc9019c1d3bea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733819:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x22313a05 (ffff93774e575200) 00010000:00010000:2.0:1789265502.733822:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265502.733828:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937643219600/0xbbfdc9019c1d3bea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733835:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219600/0xbbfdc9019c1d3bea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733897:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3bff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733904:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3bff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733910:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3bff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733915:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fca00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265502.733918:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3bff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733924:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3bff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733932:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93774f0ea300) 00010000:00010000:2.0:1789265502.733934:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265502.733936:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3bff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733952:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fca00/0xbbfdc9019c1d3bff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733975:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3c68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733981:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3c68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733986:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3c68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.733991:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265502.733994:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3c68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734000:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3c68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734006:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x22313a05 (ffff93774e575200) 00010000:00010000:2.0:1789265502.734009:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265502.734011:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3c68 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734016:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3c68 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734030:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734036:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734047:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734052:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265502.734055:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734062:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734071:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9377446e4600) 00010000:00010000:2.0:1789265502.734074:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265502.734077:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c84 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734083:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3c84 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.734205:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9dd771/0xbbfdc9019c1d3c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.734215:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9dd771/0xbbfdc9019c1d3c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.734234:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c9dd771/0xbbfdc9019c1d3c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265502.734285:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265502.734571:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265502.734578:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c9dd771/0xbbfdc9019c1d3c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734587:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031400 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:2.0:1789265502.734592:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c9dd771/0xbbfdc9019c1d3c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734598:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c9dd771/0xbbfdc9019c1d3c92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734626:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c9dd771/0xbbfdc9019c1d3c92 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734704:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9dd771/0xbbfdc9019c1d3c92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265502.734725:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265502.734727:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265502.734728:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265502.734898:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876180578978944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1543us (1710us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789265502.734907:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1789265502.735064:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93774f299f80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789265502.735072:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578978944:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789265502.772745:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265502.976005:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265502.976066:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265502.976094:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265502.976113:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265502.976130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265502.976149:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265502.976181:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556867712 00000100:00100000:1.0:1789265502.976193:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556867712 00000100:00100000:1.0:1789265502.976252:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556867968 00000100:00100000:1.0:1789265502.976254:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556867968 00000100:00100000:1.0:1789265502.976267:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556867584 00000100:00100000:1.0:1789265502.976269:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556867584 00000100:00100000:0.0:1789265502.976280:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556868096 00000100:00100000:0.0:1789265502.976287:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556868096 00000100:00100000:1.0:1789265502.976294:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 229 00000100:00100000:1.0:1789265502.976308:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556867712:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265502.976328:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 230 00000100:00100000:0.0:1789265502.976339:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556867968:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265502.976427:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556867712:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 121us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265502.976436:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 229 00000100:00100000:1.0:1789265502.976461:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 231 00000100:00100000:1.0:1789265502.976469:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556867584:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265502.976567:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556867456 00000100:00100000:3.0:1789265502.976573:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556867456 00000100:00100000:3.0:1789265502.976632:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 342 00000100:00100000:3.0:1789265502.976641:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2397:x1876180556867456:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265502.978759:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556867968:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 2405us (2645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265502.978778:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 230 00000100:00100000:0.0:1789265502.978828:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 232 00000100:00100000:0.0:1789265502.978879:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556868096:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265502.979236:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556868096:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 378us (3083us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265502.979245:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 232 00000100:00100000:1.0:1789265502.979838:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556867584:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 3365us (3717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265502.979846:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 231 00000100:00100000:1.0:1789265502.979898:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556867840 00000100:00100000:1.0:1789265502.979908:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556867840 00000100:00100000:1.0:1789265502.979972:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 112 00000100:00100000:1.0:1789265502.979983:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556867840:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265502.980018:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556867840:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 38us (3886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265502.980025:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 112 00000100:00080000:1.0:1789265502.980050:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265502.980056:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265502.980059:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265502.980427:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2397:x1876180556867456:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 3783us (4433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265502.980440:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 342 00000020:00000080:0.0:1789265503.392630:0:13733:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2916ea60 20000000:00000080:0.0:1789265503.392662:0:13733:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93764363e800 uarg=0000000000000000 20000000:01000000:0.0:1789265503.392727:0:13733:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789265503.392736:0:13733:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789265503.392742:0:13733:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1789265503.396347:0:13734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789265503.396609:0:13733:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789265503.403646:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789265503.403697:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789265503.403713:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789265503.403732:0:13733:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789265503.403758:0:13733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.403782:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bd200/0xbbfdc9019c1d3b26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3b1f expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.403791:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3b34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3b2d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.403798:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d3b42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3b3b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.403806:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d3b50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3b49 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.403816:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d3b57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190d4 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.403844:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9376435fd400/0xbbfdc9019c1d3b5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190db expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.403852:0:13733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.403931:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9376435fd400/0xbbfdc9019c1d3b5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190db expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.403948:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9376435fd400/0xbbfdc9019c1d3b5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190db expref: 12 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265503.403966:0:13733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f422300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1876180578979072:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265503.404108:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d3b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190d4 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.404117:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d3b57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190d4 expref: 12 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265503.404125:0:13733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1876180578979200:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265503.404169:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d3b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3b49 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.404179:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d3b50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b49 expref: 23 pid: 6513 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265503.404189:0:13733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f421c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1876180578979328:0@lo:104: 00000100:00100000:0.0:1789265503.404243:0:13733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265503.404299:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d3b42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3b3b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.404307:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d3b42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b3b expref: 23 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265503.404316:0:13733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1876180578979456:0@lo:104: 00010000:00010000:0.0:1789265503.404341:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3b34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3b2d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.404348:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3b34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b2d expref: 23 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265503.404356:0:13733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f421500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1876180578979584:0@lo:104: 00010000:00010000:0.0:1789265503.404380:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bd200/0xbbfdc9019c1d3b26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d3b1f expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.404399:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9377532bd200/0xbbfdc9019c1d3b26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b1f expref: 23 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265503.404407:0:13733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f421180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1876180578979712:0@lo:104: 00000100:00100000:0.0:1789265503.404428:0:13733:0:(client.c:2715:ptlrpc_set_wait()) set ffff937757aeccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265503.404527:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789265503.404552:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265503.404583:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265503.404592:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265503.404602:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578979328 00000100:00100000:2.0:1789265503.404611:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578979328 00000100:00100000:2.0:1789265503.404676:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578979456 00000100:00100000:2.0:1789265503.404680:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578979456 00000100:00100000:2.0:1789265503.404692:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578979584 00000100:00100000:2.0:1789265503.404694:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578979584 00000100:00100000:2.0:1789265503.404703:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578979712 00000100:00100000:2.0:1789265503.404705:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578979712 00000100:00100000:2.0:1789265503.404722:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265503.404733:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+6:13733:x1876180578979328:12345-0@lo:104: 00010000:00010000:2.0:1789265503.404750:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3b50 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265503.404830:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265503.404847:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+6:13733:x1876180578979328:12345-0@lo:104: Request processed in 107us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265503.404856:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265503.404944:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265503.404952:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643643800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+5:13733:x1876180578979456:12345-0@lo:104: 00010000:00010000:2.0:1789265503.404961:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3b42 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.404967:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265503.404977:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3b50 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.404987:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643219200 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265503.404993:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3b50 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.405003:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3b50 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265503.405012:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:1.0:1789265503.405012:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3b50 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265503.405022:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643643800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+5:13733:x1876180578979456:12345-0@lo:104: Request processed in 70us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265503.405033:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 10000000:01000000:1.0:1789265503.405042:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789265503.405051:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265503.405059:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643643b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+4:13733:x1876180578979584:12345-0@lo:104: 00010000:00010000:2.0:1789265503.405068:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3b34 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.405082:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3b50 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.405091:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265503.405101:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265503.405109:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643643b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+4:13733:x1876180578979584:12345-0@lo:104: Request processed in 52us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265503.405116:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1789265503.405119:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3b50 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.405129:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937643219200/0xbbfdc9019c1d3b49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3b50 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265503.405144:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1789265503.405147:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265503.405152:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3b42 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265503.405156:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643641c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:13733:x1876180578979712:12345-0@lo:104: 00010000:00010000:1.0:1789265503.405166:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc200 already unused, calling callback (ffffffffc13cbc20) 00010000:00010000:2.0:1789265503.405169:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3b26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265503.405171:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3b42 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.405180:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3b42 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265503.405190:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3b42 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265503.405196:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265503.405212:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789265503.405212:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3b42 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265503.405223:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643641c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:50e161d8-da73-42e3-8b96-d311cd2235de+3:13733:x1876180578979712:12345-0@lo:104: Request processed in 70us (628us total) trans 0 rc 0/0 00010000:00010000:1.0:1789265503.405224:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789265503.405231:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1789265503.405253:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265503.405253:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3b42 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.405263:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d3b3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3b42 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.405275:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265503.405279:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3b26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.405286:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fda00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265503.405289:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3b26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.405296:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3b26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265503.405302:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3b26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265503.405307:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789265503.405320:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3b26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.405326:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265503.405331:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3b26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.405338:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d3b1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3b26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.405347:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265503.405354:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265503.405355:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265503.405370:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578979840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265503.405923:0:13733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f421c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1876180578979328:0@lo:104: 00000100:00100000:0.0:1789265503.405935:0:13733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1876180578979456:0@lo:104: 00000100:00100000:0.0:1789265503.405947:0:13733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f421500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1876180578979584:0@lo:104: 00000100:00100000:0.0:1789265503.405955:0:13733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f421180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1876180578979712:0@lo:104: 00000100:00100000:0.0:1789265503.407230:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578979968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265503.407315:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265503.407582:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578979968 00000100:00100000:3.0:1789265503.407592:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578979968 00010000:00010000:3.0:1789265503.407637:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d3b42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b3b expref: 24 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265503.407675:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789265503.407685:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f422d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3643:x1876180578979968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265503.407711:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265503.407719:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d3b42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b3b expref: 24 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.407732:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d3b42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b3b expref: 24 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.407759:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bd600/0xbbfdc9019c1d3b42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b3b expref: 24 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.407777:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265503.407819:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f422d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+23:3643:x1876180578979968:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265503.407826:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789265503.407948:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265503.408023:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265503.408047:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556868224 00000100:00100000:3.0:1789265503.408051:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556868224 00010000:00010000:3.0:1789265503.408068:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d3b57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190d4 expref: 13 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265503.408084:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556868352 00000100:00100000:3.0:1789265503.408087:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556868352 00010000:00010000:3.0:1789265503.408097:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9376435fd400/0xbbfdc9019c1d3b5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190db expref: 14 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265503.408108:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:3.0:1789265503.408114:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+14:2400:x1876180556868224:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265503.408123:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265503.408133:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d3b57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190d4 expref: 14 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.408142:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d3b57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190d4 expref: 14 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.408153:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265503.408196:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+14:2400:x1876180556868224:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265503.408203:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:3.0:1789265503.408219:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:2.0:1789265503.408225:0:13733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f422300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1876180578979072:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265503.408227:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f425180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2399:x1876180556868352:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265503.408245:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bc600/0xbbfdc9019c1d3b57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190d4 expref: 13 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.408256:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789265503.408259:0:13733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1876180578979200:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265503.408265:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9376435fd400/0xbbfdc9019c1d3b5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190db expref: 12 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.408278:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9376435fd400/0xbbfdc9019c1d3b5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190db expref: 12 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.408291:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9376435fd400/0xbbfdc9019c1d3b5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9190db expref: 12 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.408302:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265503.408303:0:13733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265503.408324:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f425180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+11:2399:x1876180556868352:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 98us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265503.408331:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:0.0:1789265503.409604:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578979968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265503.409637:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265503.409767:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578980096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265503.409826:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265503.412997:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578980096 00000100:00100000:3.0:1789265503.413020:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578980096 00010000:00010000:3.0:1789265503.413085:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bd200/0xbbfdc9019c1d3b26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b1f expref: 23 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265503.413163:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265503.413175:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+23:3643:x1876180578980096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265503.413195:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265503.413202:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bd200/0xbbfdc9019c1d3b26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b1f expref: 23 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.413217:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bd200/0xbbfdc9019c1d3b26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b1f expref: 23 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.413242:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bd200/0xbbfdc9019c1d3b26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b1f expref: 23 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.413262:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265503.413347:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+22:3643:x1876180578980096:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (3520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265503.413355:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265503.413556:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180578980096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265503.413881:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265503.414043:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578979840 00000100:00100000:0.0:1789265503.414050:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578979840 00010000:00010000:0.0:1789265503.414075:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d3b50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b49 expref: 22 pid: 6513 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265503.414193:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789265503.414204:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+22:3646:x1876180578979840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265503.414216:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265503.414221:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d3b50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b49 expref: 22 pid: 6513 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.414232:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d3b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b49 expref: 22 pid: 6513 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.414246:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d3b50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b49 expref: 22 pid: 6513 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265503.414258:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265503.414306:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+21:3646:x1876180578979840:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265503.414312:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265503.414378:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578979840:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265503.415667:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265503.415673:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265503.415676:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265503.416003:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d3b34 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265503.416020:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392000 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265503.416025:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d3b34 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265503.416035:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d3b34 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265503.416042:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d3b34 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265503.416048:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265503.416103:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3b34 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265503.416127:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265503.416168:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3b34 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265503.416177:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3b2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d3b34 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265503.416196:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789265503.416197:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265503.416200:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265503.416204:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265503.416221:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578980224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265503.416299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265503.420587:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578980224 00000100:00100000:3.0:1789265503.420610:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578980224 00010000:00010000:3.0:1789265503.420667:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3b34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b2d expref: 21 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265503.420714:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789265503.420724:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+21:3646:x1876180578980224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265503.420742:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265503.420748:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3b34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b2d expref: 21 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.420782:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3b34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b2d expref: 21 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.420804:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bd800/0xbbfdc9019c1d3b34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d3b2d expref: 21 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.420823:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.420832:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.420853:0:7460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.420890:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.420898:0:7460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.420905:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.420912:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393200 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265503.420917:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.420927:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.420961:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265503.420975:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265503.420986:0:13733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.421000:0:13733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265503.421008:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937642393200/0xbbfdc9019c1d3c99 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265503.421077:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50e161d8-da73-42e3-8b96-d311cd2235de+20:3646:x1876180578980224:12345-0@lo:103:ldlm_bl.0 Request processed in 354us (4778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265503.421087:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789265503.421144:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578980224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265503.732110:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578980352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265503.732211:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265503.732310:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578980352 00000100:00100000:1.0:1789265503.732319:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578980352 00000100:00100000:1.0:1789265503.732372:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789265503.732394:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578980352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265503.732442:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265503.732504:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578980352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265503.732510:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789265503.732558:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578980352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265503.736619:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578980480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265503.736731:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265503.736960:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578980480 00000100:00100000:2.0:1789265503.736969:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578980480 00000100:00100000:2.0:1789265503.737021:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789265503.737029:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578980480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265503.737065:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265503.737112:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578980480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265503.737117:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789265503.737160:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578980480:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789265503.795039:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265504.245406:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265504.245438:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578980608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265504.245529:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265504.245613:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578980608 00000100:00100000:1.0:1789265504.245622:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578980608 00000100:00100000:1.0:1789265504.245690:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789265504.245703:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578980608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265504.245743:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265504.245795:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578980608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265504.245803:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789265504.245828:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265504.245899:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f426d80 x1876180578980608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265504.245922:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578980608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265504.249543:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265504.249575:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578980736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265504.249668:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265504.249752:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578980736 00000100:00100000:0.0:1789265504.249760:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578980736 00000100:00100000:0.0:1789265504.249834:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789265504.249845:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578980736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265504.249896:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265504.249948:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578980736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265504.249956:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1789265504.249982:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789265504.250016:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f420380 x1876180578980736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265504.250040:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578980736:0@lo:13:osp-pre-0-1.0 00000020:00000080:3.0:1789265504.609266:0:13783:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd54c9780 20000000:00000080:3.0:1789265504.609295:0:13783:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9376437f1800 uarg=0000000000000000 20000000:01000000:3.0:1789265504.609766:0:13783:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789265504.609782:0:13783:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789265504.609792:0:13783:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1789265504.610641:0:13784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789265504.610952:0:13783:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789265504.611506:0:13783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1789265504.611696:0:13783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1789265504.611799:0:13783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1789265504.612026:0:13783:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789265504.612068:0:13783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ca0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.612098:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ca0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.612189:0:13783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ca0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.612197:0:13783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ca0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.612223:0:13783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ca0 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.612237:0:13783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ca0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.612243:0:13783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643219400 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265504.612248:0:13783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ca0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.612307:0:13783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ca0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.612323:0:13783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ca0 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.612331:0:13783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ca0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.612342:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3ca0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265504.821940:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265504.821951:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff937641a6a800 from 7 10000000:01000000:0.0:1789265504.821958:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265504.822029:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265504.822044:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265504.822059:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265504.822092:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578980864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265504.822224:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265504.822279:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578980864 00000100:00100000:3.0:1789265504.822297:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578980864 00000100:00100000:0.0:1789265504.822316:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937761320b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265504.822387:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789265504.822399:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+20:6516:x1876180578980864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265504.822416:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265504.822436:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3cae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3ca7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.822481:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3cae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3ca7 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.822492:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3cae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3ca7 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.822501:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219400, rc 0) 00000100:00100000:3.0:1789265504.822611:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578980864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.822618:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789265504.822936:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578980864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265504.822956:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265504.822966:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3cae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265504.823200:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578980992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265504.823247:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265504.823295:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937761320b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265504.823379:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578980992 00000100:00100000:3.0:1789265504.823385:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578980992 00000100:00100000:3.0:1789265504.823431:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789265504.823440:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578980992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265504.825845:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578980992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2399us (2592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.825873:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789265504.826164:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578980992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265504.826219:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578981120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265504.826286:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265504.826328:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937761320b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265504.826392:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578981120 00000100:00100000:3.0:1789265504.826399:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578981120 00000100:00100000:3.0:1789265504.826457:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789265504.826466:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578981120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265504.826560:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578981120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.826567:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789265504.826746:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578981120:0@lo:503:ll_cfg_requeue.0 00010000:00010000:2.0:1789265504.827755:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265504.828391:0:13796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13796:1876180578981248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265504.828464:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265504.828504:0:13796:0:(client.c:2715:ptlrpc_set_wait()) set ffff937761320b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265504.828548:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578981248 00000100:00100000:3.0:1789265504.828556:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578981248 00000100:00100000:3.0:1789265504.828610:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789265504.828618:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:13796:x1876180578981248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265504.828723:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+21:13796:x1876180578981248:12345-0@lo:502:llog_process_th.0 Request processed in 106us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.828731:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789265504.828818:0:13796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13796:1876180578981248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265504.828846:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265504.828887:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265504.828890:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789265504.828898:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff937641a6a800 00000020:00000080:0.0:1789265504.828908:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265504.828971:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265504.828974:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265504.828976:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789265504.828978:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265504.828980:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265504.828982:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789265504.828984:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff937641a6a800 00000020:00000080:0.0:1789265504.828986:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789265504.830169:0:13796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13796:1876180578981376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265504.830232:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265504.830274:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578981376 00000100:00100000:0.0:1789265504.830280:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578981376 00000100:00100000:0.0:1789265504.830320:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789265504.830329:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:13796:x1876180578981376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265504.830447:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:13796:x1876180578981376:12345-0@lo:502:llog_process_th.0 Request processed in 118us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265504.830454:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789265504.830493:0:13796:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750e8a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789265504.830511:0:13796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13796:1876180578981376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265504.830535:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265504.830542:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265504.830544:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789265504.830547:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000100:00100000:3.0:1789265504.832963:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265504.835705:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556868480 00000100:00100000:2.0:1789265504.835730:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556868480 00000100:00100000:2.0:1789265504.836230:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 348 00000100:00100000:2.0:1789265504.836247:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+11:6173:x1876180556868480:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265504.836274:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265504.836305:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9376435fca00/0xbbfdc9019c1d3cb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919128 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265504.836368:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fca00/0xbbfdc9019c1d3cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919128 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265504.836391:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9376435fca00/0xbbfdc9019c1d3cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919128 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265504.836403:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fca00, rc 0) 00000020:01000000:3.0:1789265504.836621:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789265504.836668:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265504.836680:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.836694:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265504.836706:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789265504.836710:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93777aaec000 from 7 10000000:01000000:3.0:1789265504.836713:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265504.836752:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.836760:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.836771:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265504.836800:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f425f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578981504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265504.837550:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+12:6173:x1876180556868480:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 1300us (4587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265504.837563:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 348 00000100:00100000:3.0:1789265504.839247:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265504.839306:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775f6f9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265504.839977:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578981504 00000100:00100000:3.0:1789265504.839989:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578981504 00000100:00100000:3.0:1789265504.840132:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789265504.840142:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+21:6516:x1876180578981504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265504.840158:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265504.840176:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937643219200/0xbbfdc9019c1d3cc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3cbc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.840203:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643219200/0xbbfdc9019c1d3cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3cbc expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.840217:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937643219200/0xbbfdc9019c1d3cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3cbc expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.840228:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219200, rc 0) 00000100:00100000:3.0:1789265504.840392:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578981504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 251us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.840400:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789265504.840510:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f425f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578981504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265504.840529:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cc3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265504.840539:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3cc3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265504.840624:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578981632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265504.840660:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265504.840696:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937643557b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265504.843575:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578981632 00000100:00100000:3.0:1789265504.843589:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578981632 00000100:00100000:3.0:1789265504.843640:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789265504.843650:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578981632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265504.843823:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578981632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (3161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.843831:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789265504.844221:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578981632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265504.844277:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578981760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265504.844332:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265504.844362:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937643557b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265504.844484:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578981760 00000100:00100000:2.0:1789265504.844489:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578981760 00000100:00100000:2.0:1789265504.844523:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789265504.844531:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578981760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265504.844628:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578981760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265504.844635:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789265504.846518:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265504.846917:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578981760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265504.847231:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556868608 00000100:00100000:3.0:1789265504.847239:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556868608 00000100:00100000:3.0:1789265504.847291:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 352 00000100:00100000:3.0:1789265504.847300:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+12:6173:x1876180556868608:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265504.847455:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+12:6173:x1876180556868608:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 156us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.847464:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 352 00000100:00100000:1.0:1789265504.848065:0:13799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13799:1876180578981888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265504.848123:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265504.848156:0:13799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9376435576c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265504.849320:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578981888 00000100:00100000:3.0:1789265504.849331:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578981888 00000100:00100000:3.0:1789265504.849395:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789265504.849404:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+22:13799:x1876180578981888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265504.849561:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+22:13799:x1876180578981888:12345-0@lo:502:llog_process_th.0 Request processed in 158us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.849569:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789265504.849830:0:13799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13799:1876180578981888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265504.849892:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265504.849903:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265504.849905:0:13799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789265504.849913:0:13799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93777aaec000 00000020:00000080:1.0:1789265504.849915:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265504.849971:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265504.849974:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265504.849976:0:13799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789265504.849978:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265504.849981:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265504.849982:0:13799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789265504.849985:0:13799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93777aaec000 00000020:00000080:1.0:1789265504.849988:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789265504.850129:0:13799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13799:1876180578982016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265504.850171:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265504.850247:0:13799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9376435576c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265504.856355:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000040:00080000:0.0:1789265504.857439:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789265504.864960:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578982016 00000100:00100000:2.0:1789265504.864978:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578982016 00000100:00100000:1.0:1789265504.865138:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556868736 00000100:00100000:1.0:1789265504.865143:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556868736 00000100:00100000:1.0:1789265504.865259:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 354 00000100:00100000:1.0:1789265504.865270:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+12:6173:x1876180556868736:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265504.865447:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+12:6173:x1876180556868736:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 178us (9100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265504.865455:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 354 00000100:00100000:2.0:1789265504.876581:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789265504.876611:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+22:13799:x1876180578982016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265504.876803:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+22:13799:x1876180578982016:12345-0@lo:502:llog_process_th.0 Request processed in 206us (26629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265504.876811:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789265504.880634:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265504.880677:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556868864 00000100:00100000:2.0:1789265504.880687:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556868864 00000100:00100000:2.0:1789265504.880734:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 356 00000100:00100000:2.0:1789265504.880745:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+12:10795:x1876180556868864:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265504.880933:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+12:10795:x1876180556868864:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 189us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265504.880942:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 356 00000100:00100000:1.0:1789265504.882676:0:13799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13799:1876180578982016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265504.882719:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265504.882728:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265504.882731:0:13799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789265504.882736:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000040:00080000:0.0:1789265504.884355:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:2.0:1789265504.890197:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789265504.890236:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265504.890250:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cc3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265504.890263:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cc3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265504.890277:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265504.890280:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93774e5c3000 from 7 10000000:01000000:2.0:1789265504.890282:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265504.890325:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265504.890334:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265504.890345:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265504.890382:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578982144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265504.890470:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265504.890519:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937642659180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265504.890611:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578982144 00000100:00100000:1.0:1789265504.890619:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578982144 00000100:00100000:1.0:1789265504.890676:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789265504.890686:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+22:6516:x1876180578982144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265504.890700:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265504.890713:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937740031000/0xbbfdc9019c1d3cd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3cca expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265504.890736:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937740031000/0xbbfdc9019c1d3cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3cca expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265504.890747:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937740031000/0xbbfdc9019c1d3cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3cca expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265504.890757:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740031000, rc 0) 00000100:00100000:1.0:1789265504.890799:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578982144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265504.890805:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789265504.890908:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578982144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265504.890923:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265504.890931:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265504.890986:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578982272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265504.891638:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265504.891676:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937642659180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265504.891695:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578982272 00000100:00100000:2.0:1789265504.891699:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578982272 00000100:00100000:2.0:1789265504.891730:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1789265504.891737:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578982272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265504.891891:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578982272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265504.891898:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1789265504.891932:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578982272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265504.891966:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578982400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265504.892901:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265504.892934:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937642659180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265504.893042:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578982400 00000100:00100000:3.0:1789265504.893049:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578982400 00000100:00100000:3.0:1789265504.893087:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789265504.893096:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578982400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265504.893211:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578982400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.893218:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789265504.893268:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578982400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265504.893492:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13804:1876180578982528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265504.893529:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265504.893552:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4da80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265504.893564:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578982528 00000100:00100000:3.0:1789265504.893568:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578982528 00000100:00100000:3.0:1789265504.893592:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789265504.893605:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:13804:x1876180578982528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265504.893674:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:13804:x1876180578982528:12345-0@lo:502:llog_process_th.0 Request processed in 70us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.893681:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789265504.893717:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13804:1876180578982528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265504.893738:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265504.893748:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265504.893750:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265504.893757:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93774e5c3000 00000020:00000080:3.0:1789265504.893759:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265504.893810:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265504.894049:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265504.894051:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265504.894056:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265504.894059:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265504.894060:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789265504.894064:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93774e5c3000 00000020:00000080:3.0:1789265504.894067:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789265504.894220:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13804:1876180578982656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265504.894258:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265504.894279:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578982656 00000100:00100000:3.0:1789265504.894283:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578982656 00000100:00100000:3.0:1789265504.894308:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789265504.894314:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:13804:x1876180578982656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265504.896232:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775de4da80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265504.896541:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+23:13804:x1876180578982656:12345-0@lo:502:llog_process_th.0 Request processed in 2221us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.896552:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789265504.900988:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13804:1876180578982656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265504.901293:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265504.901304:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265504.901307:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789265504.901312:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789265504.901511:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789265504.901536:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265504.901548:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265504.901559:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265504.901569:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265504.901572:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff937779e62800 from 7 10000000:01000000:2.0:1789265504.901574:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265504.901610:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265504.901617:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265504.901627:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265504.901651:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578982784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265504.901716:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265504.901762:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937642659840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265504.901941:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578982784 00000100:00100000:3.0:1789265504.901947:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578982784 00000100:00100000:3.0:1789265504.901988:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789265504.902009:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+23:6516:x1876180578982784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265504.902023:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265504.902036:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937643218400/0xbbfdc9019c1d3cdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d3cd8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.902059:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643218400/0xbbfdc9019c1d3cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3cd8 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.902069:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937643218400/0xbbfdc9019c1d3cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d3cd8 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.902078:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643218400, rc 0) 00000100:00100000:3.0:1789265504.902118:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578982784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.902125:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789265504.902306:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578982784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265504.902318:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265504.902327:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265504.902407:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578982912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265504.902432:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265504.902461:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937642659840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265504.902475:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578982912 00000100:00100000:2.0:1789265504.902478:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578982912 00000100:00100000:2.0:1789265504.902500:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789265504.902507:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578982912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265504.902612:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578982912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265504.902619:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789265504.902649:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578982912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265504.902673:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578983040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265504.902712:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265504.902725:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff937642659840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265504.902735:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578983040 00000100:00100000:2.0:1789265504.902739:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578983040 00000100:00100000:2.0:1789265504.902755:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789265504.902761:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578983040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265504.902828:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:6516:x1876180578983040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265504.902834:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789265504.902897:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:50e161d8-da73-42e3-8b96-d311cd2235de:6516:1876180578983040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265504.905920:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265504.905962:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556868992 00000100:00100000:3.0:1789265504.905972:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556868992 00000100:00100000:3.0:1789265504.906034:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 365 00000100:00100000:3.0:1789265504.906044:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+12:10795:x1876180556868992:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265504.906188:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+12:10795:x1876180556868992:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 145us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.906205:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 365 00000100:00100000:3.0:1789265504.912716:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265504.912759:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556869120 00000100:00100000:3.0:1789265504.912769:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556869120 00000100:00100000:3.0:1789265504.912855:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 366 00000100:00100000:3.0:1789265504.912880:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+12:6173:x1876180556869120:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265504.912898:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265504.912915:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3ce6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91912f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.912942:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3ce6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91912f expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.912954:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3ce6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91912f expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.912962:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219600, rc 0) 00000100:00100000:3.0:1789265504.913014:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:6173:x1876180556869120:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 135us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.913021:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 366 00000100:00100000:0.0:1789265504.915358:0:13805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13805:1876180578983168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265504.915461:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265504.915515:0:13805:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750e8a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265504.915566:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578983168 00000100:00100000:3.0:1789265504.915574:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578983168 00000100:00100000:3.0:1789265504.915627:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789265504.915637:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:13805:x1876180578983168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265504.915752:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:13805:x1876180578983168:12345-0@lo:502:llog_process_th.0 Request processed in 117us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.915775:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789265504.915935:0:13805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13805:1876180578983168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265504.915963:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265504.915972:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265504.915974:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789265504.915980:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff937779e62800 00000020:00000080:0.0:1789265504.915983:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265504.916036:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265504.916039:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265504.916041:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789265504.916043:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265504.916046:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265504.916047:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789265504.916049:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff937779e62800 00000020:00000080:0.0:1789265504.916052:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789265504.916084:0:13805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13805:1876180578983296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265504.916118:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265504.916132:0:13805:0:(client.c:2715:ptlrpc_set_wait()) set ffff937761320b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265504.916314:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578983296 00000100:00100000:3.0:1789265504.916319:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578983296 00000100:00100000:3.0:1789265504.916346:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789265504.916354:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:13805:x1876180578983296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265504.916438:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:13805:x1876180578983296:12345-0@lo:502:llog_process_th.0 Request processed in 84us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265504.916444:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789265504.918524:0:13805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:50e161d8-da73-42e3-8b96-d311cd2235de:13805:1876180578983296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265504.918571:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265504.918580:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265504.918582:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789265504.918587:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789265504.918824:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789265504.918848:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265504.918881:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265504.918893:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265504.930301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265504.930414:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556869248 00000100:00100000:1.0:1789265504.930424:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556869248 00000100:00100000:1.0:1789265504.930483:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 369 00000100:00100000:1.0:1789265504.930494:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:6173:x1876180556869248:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265504.930692:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:6173:x1876180556869248:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 199us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265504.930701:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 369 00000100:00100000:3.0:1789265504.943441:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265504.943522:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556869376 00000100:00100000:0.0:1789265504.943533:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556869376 00000100:00100000:0.0:1789265504.943593:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 370 00000100:00100000:0.0:1789265504.943603:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:6173:x1876180556869376:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265504.943757:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:6173:x1876180556869376:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 155us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265504.943775:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 370 00000100:00100000:3.0:1789265504.952278:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265504.952364:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556869504 00000100:00100000:0.0:1789265504.952388:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556869504 00000100:00100000:0.0:1789265504.952451:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 371 00000100:00100000:0.0:1789265504.952461:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:10798:x1876180556869504:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265504.952614:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:10798:x1876180556869504:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 154us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265504.952622:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 371 00000100:00100000:2.0:1789265504.961604:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265504.961687:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556869632 00000100:00100000:1.0:1789265504.961698:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556869632 00000100:00100000:1.0:1789265504.961757:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 372 00000100:00100000:1.0:1789265504.961767:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:10798:x1876180556869632:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265504.961937:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:10798:x1876180556869632:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 170us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265504.961945:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 372 00010000:00010000:2.0:1789265505.843536:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265505.908069:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789265505.908685:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789265506.867109:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265507.316235:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578983424:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.316363:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.316436:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578983936:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.316467:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.316488:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578984448:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.316515:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.316536:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578984960:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.316556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.316586:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789265507.316592:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578983808:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.316630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.316651:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578984320:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.316672:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.316700:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578984832:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.316738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.316774:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578983680:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.316801:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.316820:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578984192:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.316841:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.316856:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180578984704:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.316930:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.316953:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789265507.316960:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578983552:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.316984:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.317001:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578984064:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.317022:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.317031:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578984576:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.317048:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.317074:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578984448 00000100:00100000:0.0:1789265507.317082:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578984448 00000100:00100000:0.0:1789265507.317135:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578984960 00000100:00100000:0.0:1789265507.317138:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578984960 00000100:00100000:0.0:1789265507.317149:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578984320 00000100:00100000:0.0:1789265507.317151:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578984320 00000100:00100000:0.0:1789265507.317162:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578984832 00000100:00100000:0.0:1789265507.317164:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578984832 00000100:00100000:0.0:1789265507.317182:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789265507.317191:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578984448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.317252:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578984448:12345-0@lo:400:kworker.0 Request processed in 62us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.317260:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789265507.317288:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789265507.317294:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1876180578984960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.317337:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1876180578984960:12345-0@lo:400:kworker.0 Request processed in 43us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.317342:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789265507.317364:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789265507.317370:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578984320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.317396:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578984320:12345-0@lo:400:kworker.0 Request processed in 27us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.317401:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789265507.317411:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789265507.317416:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578984832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.317441:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578984832:12345-0@lo:400:kworker.0 Request processed in 25us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.317447:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789265507.317469:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578983808 00000100:00100000:0.0:1789265507.317472:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578983808 00000100:00100000:0.0:1789265507.317491:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578984192 00000100:00100000:0.0:1789265507.317494:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578984192 00000100:00100000:0.0:1789265507.317505:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578984704 00000100:00100000:0.0:1789265507.317507:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578984704 00000100:00100000:0.0:1789265507.317516:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578983552 00000100:00100000:0.0:1789265507.317517:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578983552 00000100:00100000:0.0:1789265507.317525:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578984064 00000100:00100000:0.0:1789265507.317526:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578984064 00000100:00100000:0.0:1789265507.317535:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578984576 00000100:00100000:0.0:1789265507.317537:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578984576 00000100:00100000:0.0:1789265507.317549:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789265507.317554:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578983808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.317589:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578983808:12345-0@lo:400:kworker.0 Request processed in 34us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.317594:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789265507.317604:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789265507.317609:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578984192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.317636:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578984192:12345-0@lo:400:kworker.0 Request processed in 26us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.317642:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789265507.317653:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789265507.317659:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180578984704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.317685:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180578984704:12345-0@lo:400:kworker.0 Request processed in 27us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.317690:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789265507.317700:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789265507.317705:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578983552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.317726:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578983552:12345-0@lo:400:kworker.0 Request processed in 22us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.317731:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789265507.317739:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789265507.317744:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578984064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.317765:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578984064:12345-0@lo:400:kworker.0 Request processed in 21us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.317770:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789265507.317778:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789265507.317783:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578984576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.317815:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578984576:12345-0@lo:400:kworker.0 Request processed in 32us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.317822:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789265507.317853:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578983936 00000100:00100000:0.0:1789265507.317889:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578983936 00000100:00100000:0.0:1789265507.317914:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578983680 00000100:00100000:0.0:1789265507.317917:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578983680 00000100:00100000:0.0:1789265507.317932:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789265507.317937:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578983936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.317968:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578983936:12345-0@lo:400:kworker.0 Request processed in 31us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.317973:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789265507.317984:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789265507.317990:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578983680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.318017:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578983680:12345-0@lo:400:kworker.0 Request processed in 28us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.318022:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1789265507.318094:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265507.318099:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265507.318102:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265507.318104:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265507.318147:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578983552:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.318160:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578984064:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.318171:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578984576:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.318183:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578983680:0@lo:400:kworker.0 00010000:00080000:0.0:1789265507.318211:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f43b480 x1876180578984192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265507.318224:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578984192:0@lo:400:kworker.0 00010000:00080000:0.0:1789265507.318238:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f43b800 x1876180578984704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265507.318247:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180578984704:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.318296:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578983808:0@lo:400:kworker.0 00010000:00080000:0.0:1789265507.318309:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f438700 x1876180578984320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265507.318318:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578984320:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.318331:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578984832:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.318342:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578983936:0@lo:400:kworker.0 00010000:00080000:0.0:1789265507.318367:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f438000 x1876180578984448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265507.318374:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578984448:0@lo:400:kworker.0 00000100:00100000:0.0:1789265507.318386:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578984960:0@lo:400:kworker.0 00000100:00100000:3.0:1789265507.319294:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578983424 00000100:00100000:3.0:1789265507.319305:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578983424 00000100:00100000:3.0:1789265507.319375:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789265507.319390:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180578983424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265507.319467:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180578983424:12345-0@lo:400:kworker.0 Request processed in 84us (3105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265507.319474:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789265507.319538:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578983424:0@lo:400:kworker.0 00000100:00100000:3.0:1789265507.829697:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265507.829728:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578985088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265507.829819:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265507.832513:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578985088 00000100:00100000:1.0:1789265507.832534:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578985088 00000100:00100000:1.0:1789265507.832609:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789265507.832623:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578985088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265507.832664:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265507.832773:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578985088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 154us (2954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265507.832781:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789265507.832892:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578985088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265507.835010:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265507.835040:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578985216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265507.835127:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265507.835228:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578985216 00000100:00100000:0.0:1789265507.835238:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578985216 00000100:00100000:0.0:1789265507.835304:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789265507.835314:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876180578985216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265507.835351:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265507.835441:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876180578985216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265507.835448:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789265507.835932:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578985216:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265507.891181:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265508.093981:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265508.094103:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556869760 00000100:00100000:2.0:1789265508.094116:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556869760 00000100:00100000:2.0:1789265508.094184:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 374 00000100:00100000:2.0:1789265508.094195:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2397:x1876180556869760:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265508.094279:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2397:x1876180556869760:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 86us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265508.094287:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 374 00000100:00100000:1.0:1789265508.098009:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265508.098055:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265508.098110:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265508.098142:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265508.098166:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265508.098265:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556870016 00000100:00100000:0.0:1789265508.098275:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556870016 00000100:00100000:0.0:1789265508.098334:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556870272 00000100:00100000:0.0:1789265508.098353:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556870272 00000100:00100000:0.0:1789265508.098368:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556869888 00000100:00100000:0.0:1789265508.098371:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556869888 00000100:00100000:0.0:1789265508.098383:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556870400 00000100:00100000:0.0:1789265508.098385:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556870400 00000100:00100000:0.0:1789265508.098400:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 239 00000100:00100000:0.0:1789265508.098409:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556870016:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265508.098482:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556870016:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 74us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265508.098489:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 239 00000100:00100000:0.0:1789265508.098506:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 240 00000100:00100000:0.0:1789265508.098512:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556870272:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265508.098536:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556870272:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 25us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265508.098542:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 240 00000100:00100000:0.0:1789265508.098569:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 241 00000100:00100000:0.0:1789265508.098575:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556869888:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265508.098615:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556869888:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 39us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265508.098621:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 241 00000100:00100000:0.0:1789265508.098638:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 242 00000100:00100000:0.0:1789265508.098643:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556870400:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265508.098665:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556870400:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265508.098670:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 242 00000100:00100000:0.0:1789265508.098689:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556870144 00000100:00100000:0.0:1789265508.098692:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556870144 00000100:00100000:0.0:1789265508.098721:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 117 00000100:00100000:0.0:1789265508.098728:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556870144:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265508.098750:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556870144:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265508.098756:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 117 00000100:00080000:1.0:1789265508.099835:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265508.099842:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265508.099845:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:3.0:1789265508.365778:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1789265508.851956:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578985344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265508.852045:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265508.852195:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578985344 00000100:00100000:0.0:1789265508.852204:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578985344 00000100:00100000:0.0:1789265508.852259:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789265508.852269:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578985344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265508.852304:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265508.852387:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578985344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265508.852395:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789265508.852602:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578985344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265508.852925:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578985472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265508.852965:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265508.852992:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578985472 00000100:00100000:2.0:1789265508.852997:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578985472 00000100:00100000:2.0:1789265508.853039:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789265508.853048:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578985472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265508.853069:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789265508.853120:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578985472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265508.853127:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789265508.858222:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578985472:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789265508.915114:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265509.365549:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578985600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265509.365624:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265509.372748:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578985600 00000100:00100000:3.0:1789265509.373042:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578985600 00000100:00100000:3.0:1789265509.373133:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789265509.373147:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578985600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265509.373186:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265509.373276:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578985600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (7650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265509.373283:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:3.0:1789265509.373360:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f424000 x1876180578985600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265509.373381:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578985600:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789265509.374986:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265509.376062:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578985728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265509.376134:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265509.376287:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578985728 00000100:00100000:2.0:1789265509.376295:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578985728 00000100:00100000:2.0:1789265509.376373:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789265509.376382:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578985728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265509.376403:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789265509.378106:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265509.381208:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578985728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4816us (5062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265509.381240:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:1.0:1789265509.385502:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f43ed80 x1876180578985728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265509.389698:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578985728:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789265509.939739:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265510.963386:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265511.987700:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265512.436212:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578986112:0@lo:400:kworker.0 00000100:00100000:2.0:1789265512.436290:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265512.436367:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578986624:0@lo:400:kworker.0 00000100:00100000:2.0:1789265512.436397:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265512.436415:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578987136:0@lo:400:kworker.0 00000100:00100000:2.0:1789265512.436436:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265512.436457:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789265512.436463:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578986240:0@lo:400:kworker.0 00000100:00100000:2.0:1789265512.436482:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265512.436500:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578986752:0@lo:400:kworker.0 00000100:00100000:2.0:1789265512.436535:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265512.436553:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578987264:0@lo:400:kworker.0 00000100:00100000:2.0:1789265512.436575:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265512.436623:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578986624 00000100:00100000:2.0:1789265512.436630:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578986624 00000100:00100000:2.0:1789265512.436681:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578987136 00000100:00100000:2.0:1789265512.436684:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578987136 00000100:00100000:2.0:1789265512.436698:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578986240 00000100:00100000:2.0:1789265512.436701:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578986240 00000100:00100000:2.0:1789265512.436715:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789265512.436724:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578986624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265512.436773:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578986624:12345-0@lo:400:kworker.0 Request processed in 51us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265512.436799:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789265512.436818:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789265512.436824:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578987136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265512.436855:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578987136:12345-0@lo:400:kworker.0 Request processed in 31us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265512.436893:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789265512.436906:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789265512.436913:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578986240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265512.436941:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578986240:12345-0@lo:400:kworker.0 Request processed in 29us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265512.436947:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789265512.436986:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578986240:0@lo:400:kworker.0 00010000:00080000:2.0:1789265512.436999:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f43e680 x1876180578986624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265512.437008:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578986624:0@lo:400:kworker.0 00010000:00080000:2.0:1789265512.437018:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f43d880 x1876180578987136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265512.437027:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578987136:0@lo:400:kworker.0 00000100:00100000:0.0:1789265512.437391:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578986112 00000100:00100000:0.0:1789265512.437397:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578986112 00000100:00100000:0.0:1789265512.437438:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789265512.437454:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578986112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265512.437504:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578986112:12345-0@lo:400:kworker.0 Request processed in 52us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265512.437511:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789265512.437552:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578986752 00000100:00100000:0.0:1789265512.437556:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578986752 00000100:00100000:0.0:1789265512.437581:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578987264 00000100:00100000:0.0:1789265512.437584:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578987264 00000100:00100000:0.0:1789265512.437613:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789265512.437621:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578986752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265512.437652:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578986752:12345-0@lo:400:kworker.0 Request processed in 32us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265512.437658:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789265512.437670:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789265512.437676:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578987264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265512.437702:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578987264:12345-0@lo:400:kworker.0 Request processed in 27us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265512.437708:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1789265512.437727:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265512.437730:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265512.437733:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789265512.437757:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f43f800 x1876180578986752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265512.437767:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578986752:0@lo:400:kworker.0 00000100:00100000:0.0:1789265512.437777:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578987264:0@lo:400:kworker.0 00000100:00100000:0.0:1789265512.437786:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578986112:0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.438280:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180578985984:0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.438332:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265512.438378:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180578986496:0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.438402:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265512.438421:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876180578987008:0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.438442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265512.438465:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789265512.438472:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578985856:0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.438499:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265512.438613:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578986368:0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.438641:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265512.438661:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578986880:0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.438683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265512.438697:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578987392:0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.438714:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265512.438745:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578985984 00000100:00100000:1.0:1789265512.438749:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578985984 00000100:00100000:1.0:1789265512.438779:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578986496 00000100:00100000:1.0:1789265512.438782:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578986496 00000100:00100000:1.0:1789265512.438798:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578987008 00000100:00100000:1.0:1789265512.438801:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578987008 00000100:00100000:1.0:1789265512.438814:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789265512.438820:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180578985984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.438890:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180578985984:12345-0@lo:400:kworker.0 Request processed in 69us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265512.438897:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789265512.438912:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789265512.438918:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180578986496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.438948:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180578986496:12345-0@lo:400:kworker.0 Request processed in 30us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265512.438954:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789265512.438965:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789265512.438970:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876180578987008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.438996:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876180578987008:12345-0@lo:400:kworker.0 Request processed in 25us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265512.439012:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789265512.439062:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180578985984:0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.439073:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180578986496:0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.439082:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876180578987008:0@lo:400:kworker.0 00000100:00100000:3.0:1789265512.439312:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578986368 00000100:00100000:3.0:1789265512.439317:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578986368 00000100:00100000:3.0:1789265512.439354:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789265512.439361:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578986368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265512.439411:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578986368:12345-0@lo:400:kworker.0 Request processed in 50us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265512.439417:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789265512.439446:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578986368:0@lo:400:kworker.0 00000100:00100000:0.0:1789265512.439539:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578985856 00000100:00100000:0.0:1789265512.439543:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578985856 00000100:00100000:0.0:1789265512.439745:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789265512.439757:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180578985856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265512.439807:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180578985856:12345-0@lo:400:kworker.0 Request processed in 52us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265512.439895:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578986880 00000100:00100000:1.0:1789265512.439900:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578986880 00000100:00100000:1.0:1789265512.439928:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578987392 00000100:00100000:1.0:1789265512.439931:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578987392 00000100:00100000:1.0:1789265512.439952:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789265512.439958:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578986880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.439990:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578986880:12345-0@lo:400:kworker.0 Request processed in 32us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265512.439996:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789265512.440007:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789265512.440013:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578987392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265512.440054:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578987392:12345-0@lo:400:kworker.0 Request processed in 42us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265512.440060:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1789265512.440099:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265512.440102:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265512.440104:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265512.442148:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180578985856:0@lo:400:kworker.0 00010000:00080000:2.0:1789265512.442170:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f43fb80 x1876180578986880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265512.442182:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578986880:0@lo:400:kworker.0 00000100:00100000:2.0:1789265512.442216:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789265512.442221:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93774f299f80, transno 4294967301 00000100:00100000:2.0:1789265512.442245:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578987392:0@lo:400:kworker.0 00000100:00100000:0.0:1789265512.444793:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789265512.947269:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265512.947306:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578987520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265512.947388:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265512.947507:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578987520 00000100:00100000:0.0:1789265512.947515:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578987520 00000100:00100000:0.0:1789265512.947571:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789265512.947581:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578987520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265512.947624:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265512.947679:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578987520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265512.947687:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789265512.949369:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578987520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265512.949582:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578987648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265512.949652:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265512.949812:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578987648 00000100:00100000:3.0:1789265512.949819:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578987648 00000100:00100000:3.0:1789265512.949891:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789265512.949902:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578987648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265512.949935:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265512.949982:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578987648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265512.949989:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789265512.950026:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578987648:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789265513.011630:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265513.227937:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265513.227986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265513.228021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265513.228068:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265513.228307:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556870656 00000100:00100000:3.0:1789265513.228318:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556870656 00000100:00100000:3.0:1789265513.228388:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556871168 00000100:00100000:3.0:1789265513.228391:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556871168 00000100:00100000:3.0:1789265513.228407:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556871040 00000100:00100000:3.0:1789265513.228410:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556871040 00000100:00100000:3.0:1789265513.228428:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 249 00000100:00100000:3.0:1789265513.228438:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556870656:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265513.228820:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556870656:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 79us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265513.228848:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 249 00000100:00100000:3.0:1789265513.228900:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 250 00000100:00100000:3.0:1789265513.228908:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556871168:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265513.228937:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556871168:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 31us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265513.228943:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 250 00000100:00100000:3.0:1789265513.228956:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 251 00000100:00100000:3.0:1789265513.228962:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556871040:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265513.228986:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556871040:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265513.228992:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 251 00000100:00100000:3.0:1789265513.229041:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265513.229403:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265513.229677:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556870528 00000100:00100000:3.0:1789265513.229684:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556870528 00000100:00100000:3.0:1789265513.229720:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 376 00000100:00100000:3.0:1789265513.229728:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:2397:x1876180556870528:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265513.229763:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:2397:x1876180556870528:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 36us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265513.229769:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 376 00000100:00100000:3.0:1789265513.229796:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556870784 00000100:00100000:3.0:1789265513.229800:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556870784 00000100:00100000:3.0:1789265513.229820:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 252 00000100:00100000:3.0:1789265513.229827:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556870784:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265513.229887:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556870784:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 60us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265513.229894:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 252 00000100:00080000:0.0:1789265513.229980:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265513.229985:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265513.230181:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556870912 00000100:00100000:2.0:1789265513.230186:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556870912 00000100:00100000:2.0:1789265513.230233:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 122 00000100:00100000:2.0:1789265513.230241:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556870912:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265513.230279:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556870912:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 40us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265513.230299:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 122 00000100:00080000:0.0:1789265513.230629:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265513.971709:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265513.971743:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578987776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265513.971849:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265513.971914:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265513.972181:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578987904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265513.972324:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265513.972449:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578987776 00000100:00100000:1.0:1789265513.972460:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578987776 00000100:00100000:1.0:1789265513.972531:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578987904 00000100:00100000:1.0:1789265513.972535:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578987904 00000100:00100000:1.0:1789265513.972557:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789265513.972566:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578987776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265513.972612:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789265513.972737:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789265513.972749:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578987776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 181us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265513.972761:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578987904:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265513.972770:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000004:00000024:3.0:1789265513.974152:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265513.974525:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578987904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1774us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265513.974538:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789265513.975510:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578987776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265513.975648:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578987904:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789265514.037314:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265514.485349:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578988032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265514.485426:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265514.486915:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578988032 00000100:00100000:3.0:1789265514.486926:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578988032 00000100:00100000:3.0:1789265514.486994:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789265514.487005:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578988032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265514.487046:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265514.487123:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578988032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265514.487130:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:3.0:1789265514.487177:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f427b80 x1876180578988032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265514.487199:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578988032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265514.487291:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265514.487306:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578988160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265514.487350:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789265514.487351:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265514.491103:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578988160 00000100:00100000:3.0:1789265514.491117:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578988160 00000100:00100000:3.0:1789265514.491201:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789265514.491211:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578988160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265514.491236:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265514.491345:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578988160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (3996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265514.491352:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1789265514.491430:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265514.492350:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f43f100 x1876180578988160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265514.492374:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578988160:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789265515.060853:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265515.127728:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789265515.136113:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789265516.083059:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265517.107332:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265517.555188:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578988416:0@lo:400:kworker.0 00000100:00100000:0.0:1789265517.555265:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578988544:0@lo:400:kworker.0 00000100:00100000:3.0:1789265517.555305:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265517.555318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265517.555481:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180578989056:0@lo:400:kworker.0 00000100:00100000:0.0:1789265517.555509:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265517.555527:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180578989568:0@lo:400:kworker.0 00000100:00100000:0.0:1789265517.555548:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265517.555597:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578988416 00000100:00100000:0.0:1789265517.555605:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578988416 00000100:00100000:3.0:1789265517.555631:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578988928:0@lo:400:kworker.0 00000100:00100000:0.0:1789265517.555658:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578989056 00000100:00100000:0.0:1789265517.555663:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578989056 00000100:00100000:3.0:1789265517.555666:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265517.555684:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180578989440:0@lo:400:kworker.0 00000100:00100000:0.0:1789265517.555695:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578989568 00000100:00100000:0.0:1789265517.555700:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578989568 00000100:00100000:3.0:1789265517.555708:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265517.555725:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578988928 00000100:00100000:0.0:1789265517.555729:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578988928 00000100:00100000:0.0:1789265517.555746:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578989440 00000100:00100000:0.0:1789265517.555749:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578989440 00000100:00080000:3.0:1789265517.555760:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265517.555766:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265517.555771:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789265517.555782:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578988416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265517.555847:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578988416:12345-0@lo:400:kworker.0 Request processed in 66us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265517.555856:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789265517.555897:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789265517.555913:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180578989056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265517.555952:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180578989056:12345-0@lo:400:kworker.0 Request processed in 41us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265517.555959:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789265517.555971:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789265517.555977:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180578989568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265517.556005:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180578989568:12345-0@lo:400:kworker.0 Request processed in 28us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265517.556012:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789265517.556028:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789265517.556036:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578988928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265517.556044:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578988416:0@lo:400:kworker.0 00000100:00100000:0.0:1789265517.556071:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578988928:12345-0@lo:400:kworker.0 Request processed in 34us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265517.556077:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578988928:0@lo:400:kworker.0 00000100:00100000:0.0:1789265517.556081:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789265517.556101:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789265517.556109:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180578989440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.556239:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578988288:0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.556295:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265517.556327:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578988800:0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.556356:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265517.556375:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578989312:0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.556401:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265517.556419:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578989824:0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.556458:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265517.556483:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789265517.556489:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578988672:0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.556514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265517.556524:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578989184:0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.556545:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265517.556565:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578989696:0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.556585:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265517.556612:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578988288 00000100:00100000:2.0:1789265517.556616:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578988288 00000100:00100000:2.0:1789265517.556647:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789265517.556653:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578988288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.556686:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578988288:12345-0@lo:400:kworker.0 Request processed in 33us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265517.556693:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789265517.556721:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578988544 00000100:00100000:2.0:1789265517.556725:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578988544 00000100:00100000:2.0:1789265517.556748:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578988800 00000100:00100000:2.0:1789265517.556751:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578988800 00000100:00100000:2.0:1789265517.556763:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789265517.556776:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578988544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.556809:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578988544:12345-0@lo:400:kworker.0 Request processed in 34us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265517.556815:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789265517.556827:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789265517.556832:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578988800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.556855:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578988800:12345-0@lo:400:kworker.0 Request processed in 23us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265517.556888:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789265517.556904:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578989312 00000100:00100000:2.0:1789265517.556907:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578989312 00000100:00100000:2.0:1789265517.556931:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578989824 00000100:00100000:2.0:1789265517.556934:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578989824 00000100:00100000:2.0:1789265517.556944:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578989184 00000100:00100000:2.0:1789265517.556946:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578989184 00000100:00100000:2.0:1789265517.556957:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578989696 00000100:00100000:2.0:1789265517.556959:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578989696 00000100:00100000:2.0:1789265517.556972:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789265517.556979:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578989312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.557009:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578989312:12345-0@lo:400:kworker.0 Request processed in 31us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265517.557017:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789265517.557028:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789265517.557034:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578989824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.557060:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578989824:12345-0@lo:400:kworker.0 Request processed in 26us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265517.557065:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789265517.557085:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789265517.557091:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f467100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578989184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.557122:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f467100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578989184:12345-0@lo:400:kworker.0 Request processed in 31us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265517.557128:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789265517.557139:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789265517.557145:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578989696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.557169:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578989696:12345-0@lo:400:kworker.0 Request processed in 25us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265517.557175:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1789265517.557194:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265517.557198:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789265517.557222:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937779e54a80 x1876180578989184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265517.557234:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578989184:0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.557246:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578989696:0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.557269:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578988288:0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.557279:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578988800:0@lo:400:kworker.0 00010000:00080000:2.0:1789265517.557289:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937779e55180 x1876180578989312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265517.557297:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578989312:0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.557306:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578989824:0@lo:400:kworker.0 00000100:00100000:0.0:1789265517.557443:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180578989440:12345-0@lo:400:kworker.0 Request processed in 1334us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265517.557452:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789265517.557467:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578988672 00000100:00100000:0.0:1789265517.557471:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578988672 00000100:00100000:0.0:1789265517.557489:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789265517.557496:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578988672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265517.557527:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578988672:12345-0@lo:400:kworker.0 Request processed in 32us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265517.557541:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789265517.557570:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578988544:0@lo:400:kworker.0 00010000:00080000:0.0:1789265517.557582:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937779e54e00 x1876180578989056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265517.557591:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180578989056:0@lo:400:kworker.0 00010000:00080000:0.0:1789265517.557602:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775285c380 x1876180578989568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265517.557609:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180578989568:0@lo:400:kworker.0 00000100:00100000:2.0:1789265517.557791:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578988672:0@lo:400:kworker.0 00000100:00100000:3.0:1789265517.558017:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180578989440:0@lo:400:kworker.0 00000100:00100000:1.0:1789265518.067334:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265518.067358:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578989952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265518.067429:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265518.067550:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578989952 00000100:00100000:0.0:1789265518.067560:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578989952 00000100:00100000:0.0:1789265518.067617:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789265518.067628:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578989952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265518.067669:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265518.067713:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578989952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265518.067721:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789265518.067934:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578989952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265518.068338:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578990080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265518.068372:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265518.068457:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578990080 00000100:00100000:2.0:1789265518.068462:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578990080 00000100:00100000:2.0:1789265518.068501:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789265518.068509:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578990080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265518.068523:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265518.068567:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578990080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265518.068574:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789265518.068688:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578990080:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789265518.132355:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265518.336979:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265518.337038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265518.337075:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265518.337158:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556871424 00000100:00100000:1.0:1789265518.337158:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556871296 00000100:00100000:3.0:1789265518.337168:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556871424 00000100:00100000:1.0:1789265518.337168:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556871296 00000100:00100000:3.0:1789265518.337224:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556871552 00000100:00100000:3.0:1789265518.337227:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556871552 00000100:00100000:1.0:1789265518.337228:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 378 00000100:00100000:1.0:1789265518.337238:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937746af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556871296:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265518.337258:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 259 00000100:00100000:3.0:1789265518.337265:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556871424:12345-192.168.202.42@tcp:400:kworker.0 00000100:00080000:0.0:1789265518.337318:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265518.337322:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937746af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556871296:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 85us (293us total) trans 0 rc 0/0 00000100:00080000:0.0:1789265518.337322:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265518.337329:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 378 00000100:00100000:0.0:1789265518.337346:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 260 00000100:00100000:0.0:1789265518.337354:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556871552:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265518.339263:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556871424:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 1979us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265518.339276:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 259 00000100:00100000:0.0:1789265518.341672:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556871552:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 4309us (4586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265518.341697:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 260 00000100:00100000:3.0:1789265518.360551:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265518.360800:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265518.360842:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265518.360910:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556871808 00000100:00100000:1.0:1789265518.360923:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556871808 00000100:00100000:1.0:1789265518.361002:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556871936 00000100:00100000:1.0:1789265518.361012:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556871936 00000100:00100000:1.0:1789265518.361050:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 261 00000100:00100000:1.0:1789265518.361060:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556871808:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265518.361141:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556871808:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 82us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265518.361149:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 261 00000100:00100000:1.0:1789265518.361171:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 262 00000100:00100000:1.0:1789265518.361178:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556871936:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265518.361205:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556871936:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 27us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265518.361211:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 262 00000100:00080000:3.0:1789265518.361746:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265518.361750:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265518.362736:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556871680 00000100:00100000:2.0:1789265518.362748:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556871680 00000100:00080000:3.0:1789265518.362817:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265518.362823:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:2.0:1789265518.362834:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2396:x1876180556871680:12345-192.168.202.42@tcp:9:kworker.0 00000020:00000080:2.0:1789265518.362886:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3c0d 00000100:00080000:2.0:1789265518.362897:0:8434:0:(import.c:65:import_set_state_nolock()) ffff93777f369000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265518.362951:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:3.0:1789265518.363101:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265518.363107:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+2:2396:x1876180556871680:12345-192.168.202.42@tcp:9:kworker.0 Request processed in 276us (2566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265518.363115:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:1.0:1789265519.091416:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578990208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265519.091496:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265519.091633:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578990208 00000100:00100000:3.0:1789265519.091642:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578990208 00000100:00100000:3.0:1789265519.091693:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789265519.091703:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578990208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265519.091739:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789265519.091800:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578990208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265519.091807:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789265519.092342:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578990208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265519.093200:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265519.093216:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578990336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265519.093284:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265519.093397:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578990336 00000100:00100000:0.0:1789265519.093405:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578990336 00000100:00100000:0.0:1789265519.093454:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789265519.093464:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578990336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265519.093494:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265519.093537:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578990336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265519.093544:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789265519.093717:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578990336:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789265519.155143:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265519.603137:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578990464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265519.603217:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265519.603645:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578990464 00000100:00100000:3.0:1789265519.603655:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578990464 00000100:00100000:3.0:1789265519.603738:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789265519.603749:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578990464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265519.603783:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265519.603845:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578990464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265519.603853:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:1.0:1789265519.603974:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f426d80 x1876180578990464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265519.603995:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578990464:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789265519.604063:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265519.604213:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578990592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265519.604260:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265519.604374:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578990592 00000100:00100000:0.0:1789265519.604380:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578990592 00000100:00080000:2.0:1789265519.604484:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265519.605590:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789265519.605607:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578990592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265519.605630:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265519.605703:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578990592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265519.605710:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:2.0:1789265519.605820:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f475c00 x1876180578990592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265519.605841:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578990592:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789265520.179285:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265521.203273:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265522.229842:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265522.675338:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f46b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578991104:0@lo:400:kworker.0 00000100:00100000:1.0:1789265522.675407:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265522.675468:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578991616:0@lo:400:kworker.0 00000100:00100000:1.0:1789265522.675495:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265522.675512:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f46ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578992128:0@lo:400:kworker.0 00000100:00100000:1.0:1789265522.675533:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265522.675563:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789265522.675568:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f46bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578990976:0@lo:400:kworker.0 00000100:00100000:1.0:1789265522.675592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265522.675608:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180578991488:0@lo:400:kworker.0 00000100:00100000:1.0:1789265522.675627:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265522.675641:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180578992000:0@lo:400:kworker.0 00000100:00100000:1.0:1789265522.675660:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265522.675703:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578991616 00000100:00100000:1.0:1789265522.675710:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578991616 00000100:00100000:1.0:1789265522.675773:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578992128 00000100:00100000:1.0:1789265522.675776:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578992128 00000100:00100000:1.0:1789265522.675801:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789265522.675812:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578991616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265522.675894:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578991616:12345-0@lo:400:kworker.0 Request processed in 84us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265522.675901:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789265522.675919:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789265522.675925:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578992128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265522.675948:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578992128:12345-0@lo:400:kworker.0 Request processed in 24us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265522.675964:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1789265522.675979:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265522.675982:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265522.676017:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f469c00 x1876180578991616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265522.676031:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578991616:0@lo:400:kworker.0 00000100:00100000:1.0:1789265522.676040:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f46ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578992128:0@lo:400:kworker.0 00000100:00100000:1.0:1789265522.676065:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578991104 00000100:00100000:1.0:1789265522.676068:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578991104 00000100:00100000:1.0:1789265522.676092:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578991488 00000100:00100000:1.0:1789265522.676094:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578991488 00000100:00100000:1.0:1789265522.676109:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578992000 00000100:00100000:1.0:1789265522.676111:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578992000 00000100:00100000:1.0:1789265522.676123:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789265522.676129:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578991104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265522.676161:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180578991104:12345-0@lo:400:kworker.0 Request processed in 32us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265522.676167:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789265522.676177:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789265522.676182:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180578991488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265522.676202:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180578991488:12345-0@lo:400:kworker.0 Request processed in 21us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265522.676220:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789265522.676230:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789265522.676235:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180578992000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265522.676267:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180578992000:12345-0@lo:400:kworker.0 Request processed in 32us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265522.676273:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1789265522.676286:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789265522.676300:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f468e00 x1876180578991488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265522.676310:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180578991488:0@lo:400:kworker.0 00010000:00080000:1.0:1789265522.676319:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f469180 x1876180578992000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265522.676326:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180578992000:0@lo:400:kworker.0 00000100:00100000:1.0:1789265522.676334:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f46b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180578991104:0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.676418:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f46b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578990848:0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.676446:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265522.676477:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f46a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578991360:0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.676495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265522.676512:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578991872:0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.676530:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265522.676546:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789265522.676551:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578990720:0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.676572:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265522.676589:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578991232:0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.676607:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265522.676619:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578991744:0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.676634:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265522.676648:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578992256:0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.676666:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265522.676691:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578990848 00000100:00100000:3.0:1789265522.676695:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578990848 00000100:00100000:3.0:1789265522.676717:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578991360 00000100:00100000:3.0:1789265522.676719:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578991360 00000100:00100000:3.0:1789265522.676736:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578991872 00000100:00100000:3.0:1789265522.676738:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578991872 00000100:00100000:3.0:1789265522.676750:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789265522.676755:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578990848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.676787:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578990848:12345-0@lo:400:kworker.0 Request processed in 31us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265522.676792:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789265522.676803:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789265522.676809:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578991360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.676832:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578991360:12345-0@lo:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265522.676837:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789265522.676854:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789265522.676887:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578991872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.676913:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578991872:12345-0@lo:400:kworker.0 Request processed in 53us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265522.676919:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789265522.676935:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578991744 00000100:00100000:3.0:1789265522.676937:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578991744 00000100:00100000:3.0:1789265522.676956:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578992256 00000100:00100000:3.0:1789265522.676958:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578992256 00000100:00100000:3.0:1789265522.676973:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789265522.676978:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578991744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.677001:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578991744:12345-0@lo:400:kworker.0 Request processed in 23us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265522.677007:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789265522.677015:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789265522.677020:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578992256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.677038:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578992256:12345-0@lo:400:kworker.0 Request processed in 18us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265522.677043:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1789265522.677055:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265522.677058:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265522.677060:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789265522.677078:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f468a80 x1876180578991744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265522.677088:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578991744:0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.677096:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578992256:0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.677113:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f46b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578990848:0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.677122:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f46a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578991360:0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.677129:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578991872:0@lo:400:kworker.0 00000100:00100000:0.0:1789265522.677333:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578990976 00000100:00100000:0.0:1789265522.677338:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578990976 00000100:00100000:0.0:1789265522.677369:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578991232 00000100:00100000:0.0:1789265522.677372:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578991232 00000100:00100000:0.0:1789265522.677383:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789265522.677390:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578990976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265522.677435:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578990976:12345-0@lo:400:kworker.0 Request processed in 46us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265522.677441:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789265522.677459:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789265522.677464:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578991232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265522.677493:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578991232:12345-0@lo:400:kworker.0 Request processed in 29us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265522.677499:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789265522.677527:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578991232:0@lo:400:kworker.0 00000100:00100000:2.0:1789265522.677701:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578990720 00000100:00100000:2.0:1789265522.677705:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578990720 00000100:00100000:2.0:1789265522.677746:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789265522.677752:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775011b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578990720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265522.677788:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775011b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578990720:12345-0@lo:400:kworker.0 Request processed in 36us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265522.677794:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789265522.677823:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578990720:0@lo:400:kworker.0 00000100:00100000:3.0:1789265522.678036:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f46bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578990976:0@lo:400:kworker.0 00000100:00100000:0.0:1789265523.189926:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265523.189958:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578992384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265523.190055:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265523.190292:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578992384 00000100:00100000:3.0:1789265523.190303:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578992384 00000100:00100000:3.0:1789265523.190370:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789265523.190380:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578992384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265523.190412:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265523.190465:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578992384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265523.190473:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789265523.190538:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578992384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265523.190744:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265523.190755:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578992512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265523.190785:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265523.191033:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578992512 00000100:00100000:0.0:1789265523.191039:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578992512 00000100:00100000:0.0:1789265523.191085:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789265523.191093:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578992512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265523.191106:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265523.191151:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578992512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265523.191157:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789265523.191362:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578992512:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789265523.251332:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265523.456315:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265523.456363:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265523.456407:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265523.456448:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265523.456481:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265523.456651:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556872192 00000100:00100000:2.0:1789265523.456655:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556872064 00000100:00100000:2.0:1789265523.456663:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556872064 00000100:00100000:1.0:1789265523.456663:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556872192 00000100:00100000:1.0:1789265523.456719:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556872448 00000100:00100000:2.0:1789265523.456724:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 380 00000100:00100000:1.0:1789265523.456734:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556872448 00000100:00100000:2.0:1789265523.456736:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2397:x1876180556872064:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265523.456754:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556872320 00000100:00100000:1.0:1789265523.456757:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556872320 00000100:00100000:1.0:1789265523.456770:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556872576 00000100:00100000:1.0:1789265523.456772:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556872576 00000100:00100000:1.0:1789265523.456789:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 269 00000100:00100000:1.0:1789265523.456798:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556872192:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265523.456820:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2397:x1876180556872064:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 87us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265523.456828:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 380 00000100:00100000:1.0:1789265523.456842:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556872192:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 44us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265523.456851:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 269 00000100:00100000:1.0:1789265523.456916:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 270 00000100:00100000:1.0:1789265523.456923:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556872448:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265523.456969:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556872448:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 46us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265523.456977:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 270 00000100:00100000:1.0:1789265523.456990:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 271 00000100:00100000:1.0:1789265523.456997:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556872320:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265523.457027:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556872320:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 30us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265523.457033:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 271 00000100:00100000:1.0:1789265523.457048:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 272 00000100:00100000:1.0:1789265523.457055:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556872576:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265523.457093:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556872576:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 39us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265523.457100:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 272 00000100:00080000:3.0:1789265523.457805:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265523.457810:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265524.216036:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265524.216062:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578992640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265524.216143:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265524.216301:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578992640 00000100:00100000:2.0:1789265524.216309:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578992640 00000100:00100000:2.0:1789265524.216365:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789265524.216377:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578992640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265524.216415:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789265524.216480:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578992640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265524.216497:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789265524.217650:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578992768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265524.217697:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265524.217974:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578992768 00000100:00100000:3.0:1789265524.217981:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578992768 00000100:00100000:3.0:1789265524.218030:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789265524.218040:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578992768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265524.218084:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265524.218129:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578992768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265524.218137:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789265524.218381:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578992640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265524.220056:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578992768:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1789265524.222314:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f16c02c5-6a63-4180-875a-2aaaca684c23 00000020:00000080:3.0:1789265524.222325:0:9512:0:(genops.c:885:class_export_put()) final put ffff93777f36f000/f16c02c5-6a63-4180-875a-2aaaca684c23 00000020:00000080:1.0:1789265524.224882:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93777f36f000/f16c02c5-6a63-4180-875a-2aaaca684c23 for lustre-OST0001 00000020:00000080:1.0:1789265524.224947:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93777f369000 for lustre-OST0001 00010000:00010000:3.0:1789265524.276039:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265524.723294:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265524.723326:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578992896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265524.723401:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265524.723617:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578992896 00000100:00100000:0.0:1789265524.723626:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578992896 00000100:00100000:0.0:1789265524.723687:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789265524.723694:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578992896:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789265524.723892:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789265524.723965:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265524.724029:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578992896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 336us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265524.724035:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:2.0:1789265524.724100:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f476d80 x1876180578992896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265524.724116:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578992896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265524.724261:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265524.724273:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764362b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578993024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265524.724299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265524.724399:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578993024 00000100:00100000:2.0:1789265524.724403:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578993024 00000100:00100000:2.0:1789265524.724439:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789265524.724444:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578993024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265524.724451:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265524.724475:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578993024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265524.724479:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1789265524.724564:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789265524.724581:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764362b800 x1876180578993024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265524.724592:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764362b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578993024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265525.301258:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265525.363752:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789265525.369144:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265526.323092:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265527.350121:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265527.798678:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764362b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578993536:0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.798766:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265527.798818:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578994048:0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.798841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265527.798890:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578994560:0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.798914:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265527.798946:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789265527.798953:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578993152:0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.798983:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265527.799007:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578993664:0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.799032:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265527.799049:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578994176:0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.799071:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265527.799088:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578994688:0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.799109:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265527.799144:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578994048 00000100:00100000:3.0:1789265527.799206:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578994048 00000100:00100000:3.0:1789265527.799264:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578994560 00000100:00100000:3.0:1789265527.799267:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578994560 00000100:00100000:3.0:1789265527.799282:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578994176 00000100:00100000:3.0:1789265527.799284:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578994176 00000100:00100000:3.0:1789265527.799298:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578994688 00000100:00100000:3.0:1789265527.799301:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578994688 00000100:00100000:3.0:1789265527.799319:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789265527.799329:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578994048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.799393:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578994048:12345-0@lo:400:kworker.0 Request processed in 65us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265527.799401:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789265527.799421:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789265527.799428:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578994560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.799454:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578994560:12345-0@lo:400:kworker.0 Request processed in 27us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265527.799459:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789265527.799471:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789265527.799476:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578994176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.799498:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578994176:12345-0@lo:400:kworker.0 Request processed in 22us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265527.799503:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789265527.799514:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789265527.799520:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578994688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.799543:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578994688:12345-0@lo:400:kworker.0 Request processed in 24us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265527.799549:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789265527.799580:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578993152 00000100:00100000:3.0:1789265527.799585:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578993152 00000100:00100000:3.0:1789265527.799613:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789265527.799619:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578993152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.799650:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578993152:12345-0@lo:400:kworker.0 Request processed in 32us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265527.799656:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789265527.799684:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578993664 00000100:00100000:3.0:1789265527.799688:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578993664 00000100:00100000:3.0:1789265527.799714:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789265527.799721:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578993664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.799754:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578993664:12345-0@lo:400:kworker.0 Request processed in 34us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265527.799760:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789265527.799812:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578993152:0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.799826:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578993664:0@lo:400:kworker.0 00010000:00080000:3.0:1789265527.799838:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f3e0000 x1876180578994176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265527.799848:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578994176:0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.799881:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578994688:0@lo:400:kworker.0 00010000:00080000:3.0:1789265527.799893:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642664a80 x1876180578994048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265527.799902:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578994048:0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.799912:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578994560:0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800122:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764362ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578993408:0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800177:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265527.800208:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578993920:0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800234:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265527.800254:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180578994432:0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800275:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265527.800298:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789265527.800305:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764362b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578993280:0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800327:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265527.800347:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578993792:0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800370:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265527.800380:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578994304:0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800400:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265527.800426:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578993536 00000100:00100000:1.0:1789265527.800430:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578993536 00000100:00100000:1.0:1789265527.800456:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578993920 00000100:00100000:1.0:1789265527.800460:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578993920 00000100:00100000:1.0:1789265527.800473:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578994432 00000100:00100000:1.0:1789265527.800475:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578994432 00000100:00100000:1.0:1789265527.800485:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578993280 00000100:00100000:1.0:1789265527.800488:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578993280 00000100:00100000:1.0:1789265527.800497:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578993792 00000100:00100000:1.0:1789265527.800499:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578993792 00000100:00100000:1.0:1789265527.800510:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578994304 00000100:00100000:1.0:1789265527.800512:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578994304 00000100:00100000:1.0:1789265527.800526:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789265527.800532:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578993536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800587:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180578993536:12345-0@lo:400:kworker.0 Request processed in 54us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265527.800593:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789265527.800609:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789265527.800615:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578993920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800646:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180578993920:12345-0@lo:400:kworker.0 Request processed in 31us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265527.800651:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789265527.800663:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789265527.800669:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180578994432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800695:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180578994432:12345-0@lo:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265527.800701:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789265527.800712:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789265527.800717:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578993280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800743:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180578993280:12345-0@lo:400:kworker.0 Request processed in 26us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265527.800748:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789265527.800760:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789265527.800765:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578993792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800792:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180578993792:12345-0@lo:400:kworker.0 Request processed in 26us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265527.800797:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789265527.800808:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789265527.800813:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578994304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800851:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180578994304:12345-0@lo:400:kworker.0 Request processed in 37us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265527.800883:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:1.0:1789265527.800904:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265527.800908:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265527.800910:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265527.800913:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265527.800947:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764362b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180578993280:0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800956:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180578993792:0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.800965:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180578994304:0@lo:400:kworker.0 00010000:00080000:1.0:1789265527.800974:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642665c00 x1876180578993920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265527.800983:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180578993920:0@lo:400:kworker.0 00010000:00080000:1.0:1789265527.800992:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f3e3800 x1876180578994432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265527.800999:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180578994432:0@lo:400:kworker.0 00000100:00100000:1.0:1789265527.801033:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764362b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180578993536:0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.803071:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578993408 00000100:00100000:3.0:1789265527.803088:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578993408 00000100:00100000:3.0:1789265527.803854:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789265527.803904:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578993408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265527.804014:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578993408:12345-0@lo:400:kworker.0 Request processed in 116us (3834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265527.804021:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789265527.804341:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764362ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578993408:0@lo:400:kworker.0 00000100:00100000:1.0:1789265528.308814:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578994816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265528.308900:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265528.311038:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578994816 00000100:00100000:1.0:1789265528.311051:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578994816 00000100:00100000:1.0:1789265528.311132:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789265528.311141:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578994816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265528.311194:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265528.311266:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578994816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (2366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265528.311273:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789265528.311320:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578994816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265528.311638:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578994944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265528.311688:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265528.311847:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578994944 00000100:00100000:1.0:1789265528.311853:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578994944 00000100:00100000:1.0:1789265528.311898:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789265528.311904:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578994944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265528.311914:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265528.323737:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578994944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11819us (12034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265528.323753:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789265528.330440:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578994944:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789265528.373389:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265528.588843:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265528.588905:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265528.588938:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265528.588965:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265528.589018:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265528.589059:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556872832 00000100:00100000:0.0:1789265528.589069:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556872832 00000100:00100000:0.0:1789265528.589126:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556873088 00000100:00100000:0.0:1789265528.589129:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556873088 00000100:00100000:0.0:1789265528.589160:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556872960 00000100:00100000:0.0:1789265528.589163:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556872960 00000100:00100000:0.0:1789265528.589176:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556873216 00000100:00100000:0.0:1789265528.589178:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556873216 00000100:00100000:0.0:1789265528.589194:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 279 00000100:00100000:0.0:1789265528.589204:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556872832:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265528.589287:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556872832:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 85us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265528.589295:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 279 00000100:00100000:0.0:1789265528.589312:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 280 00000100:00100000:0.0:1789265528.589319:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556873088:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265528.589342:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556873088:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265528.589359:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 280 00000100:00100000:0.0:1789265528.589372:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 281 00000100:00100000:0.0:1789265528.589378:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556872960:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265528.589404:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556872960:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265528.589409:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 281 00000100:00100000:0.0:1789265528.589420:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 282 00000100:00100000:0.0:1789265528.589426:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556873216:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265528.589447:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556873216:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 21us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265528.589453:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 282 00000100:00080000:0.0:1789265528.589487:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265528.589491:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265528.589513:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556872704 00000100:00100000:0.0:1789265528.589518:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556872704 00000100:00100000:0.0:1789265528.589542:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 382 00000100:00100000:0.0:1789265528.589549:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556872704:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265528.589575:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556872704:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265528.589580:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 382 00000100:00100000:1.0:1789265529.336596:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265529.336630:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578995072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265529.336720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265529.336796:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578995072 00000100:00100000:1.0:1789265529.336805:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578995072 00000100:00100000:1.0:1789265529.336880:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789265529.336891:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f46b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578995072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265529.336931:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265529.336981:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f46b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578995072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265529.336990:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789265529.337038:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578995072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265529.337453:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578995200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265529.337559:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265529.337712:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578995200 00000100:00100000:2.0:1789265529.337717:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578995200 00000100:00100000:2.0:1789265529.337784:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789265529.337793:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578995200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265529.337814:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265529.338003:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180578995200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 210us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265529.338011:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789265529.338100:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180578995200:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789265529.396998:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265529.843535:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265529.843562:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578995328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265529.843635:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265529.843707:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578995328 00000100:00100000:3.0:1789265529.843715:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578995328 00000100:00100000:3.0:1789265529.843763:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789265529.843773:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578995328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265529.843801:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265529.843844:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578995328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265529.843851:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:3.0:1789265529.843915:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f3e0000 x1876180578995328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265529.843933:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578995328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265529.844044:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265529.849390:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265529.849417:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578995456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265529.849495:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265529.849628:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578995456 00000100:00100000:1.0:1789265529.849638:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578995456 00000100:00100000:1.0:1789265529.849714:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789265529.849723:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578995456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265529.849746:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265529.849797:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578995456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265529.849804:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:1.0:1789265529.849845:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f474000 x1876180578995456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265529.849897:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578995456:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789265529.849978:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265530.419105:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265531.320723:0:14063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:12:10 (1789265530) 00010000:00010000:3.0:1789265531.443150:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265532.469172:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265532.915828:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578995840:0@lo:400:kworker.0 00000100:00100000:3.0:1789265532.915954:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265532.916030:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578996352:0@lo:400:kworker.0 00000100:00100000:3.0:1789265532.916062:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265532.916081:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578996864:0@lo:400:kworker.0 00000100:00100000:3.0:1789265532.916103:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265532.916144:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789265532.916151:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578995968:0@lo:400:kworker.0 00000100:00100000:3.0:1789265532.916175:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265532.916191:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578996480:0@lo:400:kworker.0 00000100:00100000:3.0:1789265532.916228:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265532.916247:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578996992:0@lo:400:kworker.0 00000100:00100000:3.0:1789265532.916266:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265532.916307:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578996480 00000100:00100000:3.0:1789265532.916316:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578996480 00000100:00100000:3.0:1789265532.916389:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578996992 00000100:00100000:3.0:1789265532.916392:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578996992 00000100:00100000:3.0:1789265532.916426:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789265532.916438:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578996480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265532.916495:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578996480:12345-0@lo:400:kworker.0 Request processed in 60us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265532.916503:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789265532.916525:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789265532.916531:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578996992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265532.916568:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578996992:12345-0@lo:400:kworker.0 Request processed in 37us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265532.916574:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00080000:3.0:1789265532.916628:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9377507a2680 x1876180578996480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265532.916645:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578996480:0@lo:400:kworker.0 00000100:00100000:3.0:1789265532.916656:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578996992:0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.916887:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578995584:0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.916931:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265532.916977:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578996096:0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.917004:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265532.917026:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578996608:0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.917051:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265532.917068:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578997120:0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.917088:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265532.917108:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789265532.917129:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578995712:0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.917156:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265532.917175:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578996224:0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.917199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265532.917210:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180578996736:0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.917230:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265532.917256:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578996352 00000100:00100000:0.0:1789265532.917262:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578996352 00000100:00100000:0.0:1789265532.917297:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578996864 00000100:00100000:0.0:1789265532.917300:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578996864 00000100:00100000:0.0:1789265532.917313:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578995968 00000100:00100000:0.0:1789265532.917315:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578995968 00000100:00100000:0.0:1789265532.917326:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578995712 00000100:00100000:0.0:1789265532.917328:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578995712 00000100:00100000:0.0:1789265532.917354:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578996224 00000100:00100000:0.0:1789265532.917357:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578996224 00000100:00100000:0.0:1789265532.917368:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578996736 00000100:00100000:0.0:1789265532.917370:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578996736 00000100:00100000:0.0:1789265532.917384:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789265532.917391:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578996352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.917443:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180578996352:12345-0@lo:400:kworker.0 Request processed in 53us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265532.917458:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789265532.917472:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789265532.917477:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578996864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.917504:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180578996864:12345-0@lo:400:kworker.0 Request processed in 27us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265532.917510:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789265532.917521:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789265532.917526:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578995968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.917552:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180578995968:12345-0@lo:400:kworker.0 Request processed in 26us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265532.917558:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789265532.917569:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789265532.917574:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578995712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.917607:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578995712:12345-0@lo:400:kworker.0 Request processed in 32us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265532.917613:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789265532.917623:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789265532.917629:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578996224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.917653:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578996224:12345-0@lo:400:kworker.0 Request processed in 24us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265532.917658:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789265532.917669:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789265532.917676:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180578996736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.917702:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180578996736:12345-0@lo:400:kworker.0 Request processed in 27us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265532.917713:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:0.0:1789265532.917744:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265532.917748:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265532.917751:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265532.917754:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265532.917766:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578995840 00000100:00100000:0.0:1789265532.917770:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578995840 00000100:00100000:0.0:1789265532.917796:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578996096 00000100:00100000:0.0:1789265532.917799:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578996096 00000100:00100000:0.0:1789265532.917810:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789265532.917816:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578995840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.917852:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180578995840:12345-0@lo:400:kworker.0 Request processed in 36us (1899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265532.917902:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789265532.917915:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789265532.917923:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578996096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.917952:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578996096:12345-0@lo:400:kworker.0 Request processed in 30us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265532.917958:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789265532.917995:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578996608 00000100:00100000:0.0:1789265532.917999:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578996608 00000100:00100000:0.0:1789265532.918031:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578997120 00000100:00100000:0.0:1789265532.918035:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578997120 00000100:00100000:0.0:1789265532.918055:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789265532.918061:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f475f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578996608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.918094:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f475f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578996608:12345-0@lo:400:kworker.0 Request processed in 33us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265532.918100:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789265532.918134:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789265532.918140:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578997120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.918170:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180578997120:12345-0@lo:400:kworker.0 Request processed in 31us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265532.918176:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1789265532.918199:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265532.918202:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265532.918240:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578995712:0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.918252:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578996224:0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.918261:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180578996736:0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.918271:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578996096:0@lo:400:kworker.0 00010000:00080000:0.0:1789265532.918285:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9377507a3800 x1876180578996608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265532.918296:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578996608:0@lo:400:kworker.0 00000100:00100000:0.0:1789265532.918305:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180578997120:0@lo:400:kworker.0 00000100:00100000:3.0:1789265532.922750:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578995584 00000100:00100000:3.0:1789265532.922774:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578995584 00000100:00100000:3.0:1789265532.922924:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789265532.922939:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775011b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578995584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265532.923081:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775011b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180578995584:12345-0@lo:400:kworker.0 Request processed in 146us (6149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265532.923090:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789265532.923204:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180578995968:0@lo:400:kworker.0 00000100:00100000:3.0:1789265532.923237:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180578995840:0@lo:400:kworker.0 00010000:00080000:3.0:1789265532.923259:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9377507a0000 x1876180578996352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265532.923272:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180578996352:0@lo:400:kworker.0 00010000:00080000:3.0:1789265532.923288:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9377507a3100 x1876180578996864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265532.923297:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180578996864:0@lo:400:kworker.0 00000100:00100000:1.0:1789265532.928041:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180578995584:0@lo:400:kworker.0 00000100:00100000:2.0:1789265533.427429:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578997248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265533.427543:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265533.428164:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578997248 00000100:00100000:1.0:1789265533.428180:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578997248 00000100:00100000:1.0:1789265533.428252:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789265533.428265:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578997248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265533.428312:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265533.428413:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578997248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 150us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265533.428422:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789265533.428777:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578997248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265533.429227:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578997376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265533.429312:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265533.429427:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578997376 00000100:00100000:2.0:1789265533.429435:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578997376 00000100:00100000:2.0:1789265533.429498:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789265533.429508:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578997376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265533.429527:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265533.429580:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578997376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265533.429588:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789265533.429792:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578997376:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265533.492157:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265533.537527:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265533.537910:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556873344 00000100:00100000:0.0:1789265533.537925:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556873344 00000100:00100000:0.0:1789265533.538028:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:0.0:1789265533.538042:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:11089:x1876180556873344:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265533.538071:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265533.538116:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3ced lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919136 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.538208:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3cf4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.538243:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.538260:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789265533.538753:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1789265533.539116:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789265533.539123:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265533.539194:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.539226:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3ced lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919136 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.539243:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919136 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.539251:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774712f900) 00010000:00010000:0.0:1789265533.539253:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265533.539257:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393800, rc 0) 00000100:00100000:0.0:1789265533.539708:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:11089:x1876180556873344:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 1666us (2192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265533.539717:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:3.0:1789265533.553578:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265533.554039:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556873472 00000100:00100000:0.0:1789265533.554054:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556873472 00000100:00100000:0.0:1789265533.554146:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:0.0:1789265533.554158:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:11090:x1876180556873472:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265533.554185:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265533.554233:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3cfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91913d expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554335:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554353:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554367:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554386:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554395:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554402:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554481:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393000/0xbbfdc9019c1d3d10 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554490:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393000/0xbbfdc9019c1d3d10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554496:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393000/0xbbfdc9019c1d3d10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265533.554542:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789265533.554547:0:9988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265533.554570:0:9988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937642393000/0xbbfdc9019c1d3d10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554590:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554597:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554604:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554611:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265533.554615:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554623:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554637:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774712f900) 00010000:00010000:0.0:1789265533.554640:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265533.554645:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554651:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554667:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554673:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554677:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554689:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265533.554692:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554699:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554707:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93774712fa00) 00010000:00010000:0.0:1789265533.554709:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265533.554712:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554717:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554752:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3cfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91913d expref: 8 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554768:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393000/0xbbfdc9019c1d3d10 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91913d expref: 7 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.554775:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93774712fb00) 00010000:00010000:0.0:1789265533.554778:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265533.554780:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393000, rc 0) 00000100:00100000:0.0:1789265533.556512:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+7:11090:x1876180556873472:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 2343us (2943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265533.556527:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:3.0:1789265533.571454:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265533.571909:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556873600 00000100:00100000:1.0:1789265533.571932:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556873600 00000100:00100000:1.0:1789265533.572069:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:1.0:1789265533.572082:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f16c02c5-6a63-4180-875a-2aaaca684c23+7:11090:x1876180556873600:12345-192.168.202.42@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789265533.572221:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f16c02c5-6a63-4180-875a-2aaaca684c23+7:11090:x1876180556873600:12345-192.168.202.42@tcp:900:lhsmtool_posix.0 Request processed in 140us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265533.572229:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:3.0:1789265533.574470:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265533.574705:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556873856 00000100:00100000:0.0:1789265533.574747:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556873856 00000100:00100000:0.0:1789265533.574828:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:0.0:1789265533.574842:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:11090:x1876180556873856:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265533.574901:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265533.575223:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3d17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919144 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.575330:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d1e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.575347:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.575361:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.575604:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d25 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.575628:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.575643:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.575793:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393400/0xbbfdc9019c1d3d2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.575802:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393400/0xbbfdc9019c1d3d2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.575810:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393400/0xbbfdc9019c1d3d2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265533.576000:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789265533.576318:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.576327:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d1e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.576333:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.576340:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265533.576344:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.576352:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d1e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.576374:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93774712fb00) 00010000:00010000:0.0:1789265533.576378:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265533.576383:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d1e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.576389:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3d1e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.576403:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.576409:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d25 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.576426:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.576431:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265533.576435:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.576442:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d25 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.578314:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93774712fa00) 00010000:00010000:0.0:1789265533.578319:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265533.578324:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d25 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.578332:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3d25 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.578812:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3d17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919144 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.579572:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393400/0xbbfdc9019c1d3d2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919144 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265533.579584:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93774712f300) 00010000:00010000:0.0:1789265533.579586:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265533.579590:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393400, rc 0) 00000100:00100000:0.0:1789265533.579681:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+9:11090:x1876180556873856:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 4842us (5223us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789265533.579704:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:3.0:1789265533.588385:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265533.588934:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556873984 00000100:00100000:0.0:1789265533.588952:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556873984 00000100:00100000:0.0:1789265533.589025:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:0.0:1789265533.589036:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+9:11090:x1876180556873984:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789265533.589172:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+9:11090:x1876180556873984:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 Request processed in 137us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265533.589179:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:3.0:1789265533.594949:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265533.595025:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556874112 00000100:00100000:0.0:1789265533.595042:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556874112 00000100:00100000:0.0:1789265533.595155:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:0.0:1789265533.595169:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:11090:x1876180556874112:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1789265533.596147:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1789265533.597231:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2015us 00000100:00100000:3.0:1789265533.651383:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:11090:x1876180556874112:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 Request processed in 56201us (56444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265533.651401:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:1.0:1789265533.699352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265533.699403:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265533.699437:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265533.700122:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556874496 00000100:00100000:2.0:1789265533.700139:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556874496 00000100:00100000:2.0:1789265533.700230:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556874368 00000100:00100000:2.0:1789265533.700235:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556874368 00000100:00100000:2.0:1789265533.700268:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 289 00000100:00100000:2.0:1789265533.700281:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556874496:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265533.700406:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556874496:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 128us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265533.700415:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 289 00000100:00100000:2.0:1789265533.700437:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 290 00000100:00100000:2.0:1789265533.700446:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556874368:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265533.700473:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556874368:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 30us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265533.700480:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 290 00000100:00080000:1.0:1789265533.700691:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265533.700697:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265533.701365:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556874240 00000100:00100000:3.0:1789265533.701375:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556874240 00000100:00100000:3.0:1789265533.701441:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 384 00000100:00100000:3.0:1789265533.701451:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556874240:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265533.701519:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556874240:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 69us (2183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265533.701527:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 384 00000100:00100000:1.0:1789265534.451565:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578997504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265534.451670:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265534.451776:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578997504 00000100:00100000:1.0:1789265534.451787:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578997504 00000100:00100000:1.0:1789265534.451849:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789265534.451890:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578997504:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265534.452515:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578997632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265534.452568:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1789265534.455205:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265534.455597:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578997504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3731us (3920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265534.455611:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789265534.455659:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578997632 00000100:00100000:1.0:1789265534.455669:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578997632 00000100:00100000:1.0:1789265534.455717:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789265534.455727:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578997632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265534.455779:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265534.455838:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578997632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (3270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265534.455846:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789265534.455954:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578997632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265534.456488:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578997504:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789265534.515832:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265534.581583:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789265534.604066:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789265534.965106:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265534.965139:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578997760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265534.965233:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265534.966252:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578997760 00000100:00100000:3.0:1789265534.967435:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578997760 00000100:00100000:3.0:1789265534.967548:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789265534.967562:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578997760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265534.967605:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265534.967723:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180578997760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 164us (2489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265534.967805:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:3.0:1789265534.967937:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9377507a2d80 x1876180578997760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265534.967964:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180578997760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265534.970683:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578997888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265534.970767:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265534.970844:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578997888 00000100:00100000:2.0:1789265534.970852:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578997888 00000100:00100000:2.0:1789265534.970961:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789265534.970972:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578997888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265534.971001:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265534.971054:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180578997888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265534.971060:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:2.0:1789265534.971113:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f464000 x1876180578997888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265534.971135:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180578997888:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265534.971808:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265535.549479:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265535.604814:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789265535.611397:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789265536.022672:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265536.022740:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556874624 00000100:00100000:1.0:1789265536.022751:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556874624 00000100:00100000:1.0:1789265536.022820:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:1.0:1789265536.022832:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+9:11132:x1876180556874624:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1789265536.022856:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265536.022897:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91914b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.022964:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023192:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023209:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023226:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023248:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023255:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023305:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023312:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023319:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023325:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265536.023330:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023337:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023349:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774712f900) 00010000:00010000:1.0:1789265536.023352:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265536.023356:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023362:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023375:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023388:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023394:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023398:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265536.023402:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023408:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023416:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff937779d90300) 00010000:00010000:1.0:1789265536.023419:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265536.023422:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023428:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023461:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d3a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91914b expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023472:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774712f900) 00010000:00010000:1.0:1789265536.023474:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265536.023477:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91914b expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.023484:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740031600, rc 0) 00000100:00100000:1.0:1789265536.027738:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+9:11132:x1876180556874624:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 4895us (5063us total) trans 0 rc 301/301 00000100:00100000:1.0:1789265536.027753:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00080000:1.0:1789265536.027805:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265536.036063:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265536.036219:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556874880 00000100:00100000:1.0:1789265536.036231:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556874880 00000100:00100000:1.0:1789265536.036293:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:1.0:1789265536.036304:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+9:11132:x1876180556874880:12345-192.168.202.42@tcp:36:lfs.0 00010000:00010000:1.0:1789265536.036357:0:9988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265536.036387:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3cf4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919136 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.036406:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93774712f900) 00010000:00010000:1.0:1789265536.036416:0:9988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265536.036483:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d4f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.036497:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.036507:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.036537:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d56 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.036544:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.036551:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.037186:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.037199:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.037206:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265536.037222:0:9988:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9a6857f reply state 0000000074eacc2c transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.037233:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.037238:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:1.0:1789265536.037241:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265536.037244:0:9988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789265536.037250:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789265536.037257:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.037263:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d4f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.037269:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d4f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.037275:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265536.037279:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d4f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.037299:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d4f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.037309:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d90300) 00010000:00010000:1.0:1789265536.037311:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265536.037315:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d4f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.037321:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d4f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265536.037336:0:9988:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9a6857f reply state 0000000074eacc2c transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.037343:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.037349:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff937779d90e00) 00010000:00010000:1.0:1789265536.037351:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265536.037353:0:9988:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789265536.037454:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+10:11132:x1876180556874880:12345-192.168.202.42@tcp:36:lfs.0 Request processed in 1150us (1397us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789265536.037462:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:2.0:1789265536.152819:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265536.152953:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556875008 00000100:00100000:1.0:1789265536.152963:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556875008 00000100:00100000:1.0:1789265536.153089:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:1.0:1789265536.153102:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+10:11140:x1876180556875008:12345-192.168.202.42@tcp:101:lctl.0 00010000:00010000:1.0:1789265536.153125:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265536.153146:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919152 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.153248:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3d6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.153261:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.153274:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265536.153318:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789265536.153322:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265536.153358:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.153381:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919152 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.153398:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3d6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919152 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.153407:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d90300) 00010000:00010000:1.0:1789265536.153410:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265536.153414:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740031800, rc 0) 00000100:00100000:1.0:1789265536.153474:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+11:11140:x1876180556875008:12345-192.168.202.42@tcp:101:lctl.0 Request processed in 376us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265536.153481:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:0.0:1789265536.213900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265536.216593:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556875136 00000100:00100000:1.0:1789265536.216612:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556875136 00000100:00100000:1.0:1789265536.216727:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:1.0:1789265536.216739:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+11:11146:x1876180556875136:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1789265536.216766:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265536.216789:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919159 expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.216912:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3d79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.216926:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3d79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.216939:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3d79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.216952:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3d80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.216960:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3d80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.216967:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3d80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.218701:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd200/0xbbfdc9019c1d3d87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.218723:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd200/0xbbfdc9019c1d3d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.218735:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd200/0xbbfdc9019c1d3d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265536.218780:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789265536.218784:0:9988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265536.218828:0:9988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd200/0xbbfdc9019c1d3d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.218842:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3d79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.218850:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3d79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.218856:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3d79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.219590:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030e00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265536.219596:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3d79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.219605:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3d79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.219619:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d90300) 00010000:00010000:2.0:1789265536.219637:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265536.219642:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3d79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.219650:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3d79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.219669:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3d80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.219675:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3d80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.219691:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3d80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.219696:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265536.219699:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3d80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.219705:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3d80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.219713:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff937779d90e00) 00010000:00010000:2.0:1789265536.219715:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265536.219718:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3d80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.219723:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3d80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.219764:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3d72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919159 expref: 13 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.219792:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd200/0xbbfdc9019c1d3d87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919159 expref: 12 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.219800:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265536.219803:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789265536.219805:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd200, rc 0) 00000100:00100000:2.0:1789265536.220145:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+12:11146:x1876180556875136:12345-192.168.202.42@tcp:101:bash.0 Request processed in 3406us (6293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265536.220155:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:0.0:1789265536.226537:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265536.226629:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556875392 00000100:00100000:2.0:1789265536.226640:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556875392 00000100:00100000:2.0:1789265536.226717:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:2.0:1789265536.226728:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+12:11146:x1876180556875392:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1789265536.226750:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265536.226771:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3d8e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919160 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.226922:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3d95 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.226937:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3d95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.226949:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3d95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227026:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3d9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227047:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3d9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227053:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3d9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265536.227427:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789265536.227555:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3da3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227565:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227572:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227600:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3d95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227607:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3d95 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227614:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3d95 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227620:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265536.227625:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3d95 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227633:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3d95 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227658:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265536.227660:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265536.227666:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3d95 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227672:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3d95 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265536.227687:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c88f162 reply state 00000000301226f0 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3d9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227698:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3d9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227704:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820e00) 00010000:00010000:2.0:1789265536.227707:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265536.227710:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789265536.227741:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3d8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919160 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227756:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3da3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919160 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.227764:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820200) 00010000:00010000:2.0:1789265536.227766:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265536.227768:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fdc00, rc 0) 00000100:00100000:2.0:1789265536.227825:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+15:11146:x1876180556875392:12345-192.168.202.42@tcp:101:bash.0 Request processed in 1099us (1299us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789265536.227832:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:0.0:1789265536.238076:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265536.242807:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556875520 00000100:00100000:3.0:1789265536.242824:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556875520 00000100:00100000:3.0:1789265536.242902:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:3.0:1789265536.242911:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1876180556875520:12345-192.168.202.42@tcp:8:bash.0 00010000:00080000:3.0:1789265536.242947:0:9789:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:3.0:1789265536.244145:0:9789:0:(genops.c:1385:class_connect()) connect: client f16c02c5-6a63-4180-875a-2aaaca684c23, cookie 0xbbfdc9019c1d3db1 00002000:00100000:3.0:1789265536.244171:0:9789:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f16c02c5-6a63-4180-875a-2aaaca684c23/ffff93777f39b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789265536.244184:0:9789:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:3.0:1789265536.244272:0:9789:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789265536.244309:0:9789:0:(import.c:65:import_set_state_nolock()) ffff93777f39c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265536.244396:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2396:x1876180556875520:12345-192.168.202.42@tcp:8:bash.0 Request processed in 1483us (6327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265536.244405:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:0.0:1789265536.254947:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265536.255153:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556875648 00000100:00100000:3.0:1789265536.255174:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556875648 00000100:00100000:3.0:1789265536.255244:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:3.0:1789265536.255255:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:0:x1876180556875648:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1789265536.255275:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265536.255316:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d3db8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919167 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265536.255345:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265536.255364:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=391s v=(0 0) 00010000:00010000:3.0:1789265536.255368:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265536.255377:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d3db8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919167 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.255397:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d3db8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919167 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.255411:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643218200, rc 0) 00000100:00100000:3.0:1789265536.255481:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:0:x1876180556875648:12345-192.168.202.42@tcp:101:bash.0 Request processed in 228us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265536.255489:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00080000:1.0:1789265536.256650:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265536.261449:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265536.261558:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556875776 00000100:00100000:3.0:1789265536.261569:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556875776 00000100:00100000:3.0:1789265536.261638:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:3.0:1789265536.261649:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+7:11146:x1876180556875776:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1789265536.261667:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265536.261696:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91916e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.261729:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d3db8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919167 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.261755:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265536.261759:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265536.261765:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.261802:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d3db8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919167 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.261816:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d3db8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919167 expref: 8 pid: 8435 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265536.261831:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642664a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1876180578998016:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265536.262246:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265536.281396:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642664a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1876180578998016:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265536.281439:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.281461:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219a00, rc 0) 00000100:00100000:3.0:1789265536.281535:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+8:11146:x1876180556875776:12345-192.168.202.42@tcp:101:bash.0 Request processed in 19887us (20095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265536.281543:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:1.0:1789265536.286218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265536.286543:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556875904 00000100:00100000:0.0:1789265536.286554:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556875904 00010000:00010000:0.0:1789265536.286599:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d3db8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919167 expref: 8 pid: 8435 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265536.286672:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:0.0:1789265536.286839:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f67cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2399:x1876180556875904:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265536.286890:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265536.286912:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d3db8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919167 expref: 8 pid: 8435 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.286927:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d3db8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919167 expref: 8 pid: 8435 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.286954:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d3db8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919167 expref: 8 pid: 8435 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.286971:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265536.287233:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265536.287244:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.287254:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.287297:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265536.287313:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937747f0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1876180578998144:192.168.202.42@tcp:105: 00000100:00100000:0.0:1789265536.287413:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774557fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265536.290403:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937747f0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1876180578998144:192.168.202.42@tcp:105: 00010000:00010000:3.0:1789265536.290436:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265536.290527:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f67cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556875904:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 3844us (4319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265536.290538:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:2.0:1789265536.292308:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265536.292379:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556876160 00000100:00100000:0.0:1789265536.292390:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556876160 00000100:00100000:0.0:1789265536.292448:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:0.0:1789265536.292458:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+15:11146:x1876180556876160:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:0.0:1789265536.293415:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+16:11146:x1876180556876160:12345-192.168.202.42@tcp:35:bash.0 Request processed in 953us (1109us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789265536.293425:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:1.0:1789265536.395917:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265536.396107:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556876416 00000100:00100000:3.0:1789265536.396117:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556876416 00000100:00100000:3.0:1789265536.396189:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:3.0:1789265536.396200:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+16:11156:x1876180556876416:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265536.396226:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265536.396247:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3dc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919175 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265536.396357:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789265536.396458:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3dc6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919175 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.396473:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d90300) 00010000:00010000:3.0:1789265536.396476:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265536.396481:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3dc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919175 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.396497:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643218a00, rc 0) 00000100:00100000:3.0:1789265536.396833:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+17:11156:x1876180556876416:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 634us (924us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1789265536.396840:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:1.0:1789265536.406334:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265536.408983:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556876672 00000100:00100000:2.0:1789265536.408999:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556876672 00000100:00100000:2.0:1789265536.409154:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:2.0:1789265536.409167:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+17:11156:x1876180556876672:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1789265536.409432:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+18:11156:x1876180556876672:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 267us (3105us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789265536.409440:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:2.0:1789265536.515987:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265536.516132:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556876800 00000100:00100000:1.0:1789265536.516145:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556876800 00000100:00100000:1.0:1789265536.516215:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:1.0:1789265536.516242:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+18:11162:x1876180556876800:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1789265536.516273:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265536.516294:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3dd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91917c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.516366:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ddb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.516381:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.516397:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265536.516443:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789265536.516448:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265536.516470:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.516501:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3dd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91917c expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.516521:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ddb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91917c expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.516529:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:1.0:1789265536.516532:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265536.516535:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740030e00, rc 0) 00000100:00100000:1.0:1789265536.516608:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+19:11162:x1876180556876800:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 369us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265536.516624:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:1.0:1789265536.524620:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265536.524706:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556877056 00000100:00100000:0.0:1789265536.524717:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556877056 00000100:00100000:0.0:1789265536.525213:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:0.0:1789265536.525225:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+19:11162:x1876180556877056:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1789265536.525250:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265536.525272:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3de2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919183 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.525397:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3de9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.525415:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3de9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.525428:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3de9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265536.525440:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789265536.526026:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3de2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919183 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.526067:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3de9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919183 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.526086:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820200) 00010000:00010000:0.0:1789265536.526090:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265536.526094:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392c00, rc 0) 00000100:00100000:0.0:1789265536.526223:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+21:11162:x1876180556877056:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 999us (1614us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789265536.526232:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:3.0:1789265536.531212:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265536.531841:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556877184 00000100:00100000:2.0:1789265536.531852:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556877184 00000100:00100000:3.0:1789265536.532311:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:3.0:1789265536.532323:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+21:2398:x1876180556877184:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265536.532353:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265536.532392:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3de9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919183 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.532413:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820200) 00010000:00010000:3.0:1789265536.532417:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265536.532526:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+20:2398:x1876180556877184:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 205us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265536.532534:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:2.0:1789265536.542497:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265536.542740:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556877440 00000100:00100000:1.0:1789265536.542754:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556877440 00000100:00100000:1.0:1789265536.542819:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:1.0:1789265536.542830:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+20:11162:x1876180556877440:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1789265536.542901:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265536.542925:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3df7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91918a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.543055:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3dfe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.543070:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3dfe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.543094:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3dfe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265536.543109:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789265536.543213:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3df7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91918a expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.543232:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3dfe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91918a expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.543242:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820200) 00010000:00010000:1.0:1789265536.543245:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789265536.543262:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740031600, rc 0) 00000100:00100000:1.0:1789265536.543331:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+22:11162:x1876180556877440:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 502us (843us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789265536.543338:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 53 00010000:00010000:2.0:1789265536.564466:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265536.566543:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265536.568744:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556877568 00000100:00100000:0.0:1789265536.568762:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556877568 00000100:00100000:0.0:1789265536.568842:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:0.0:1789265536.568855:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556877568:12345-192.168.202.42@tcp:1:lfs.0 00010000:00010000:2.0:1789265536.569121:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000131683f5/0xbbfdc9019c1d3e0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.569143:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.569152:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789265536.569156:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265536.569161:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000131683f5/0xbbfdc9019c1d3e0c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.569207:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.569222:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 7 pid: 8436 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265536.569251:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f466300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1876180578998272:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265536.569365:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265536.572135:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f466300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1876180578998272:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265536.572168:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000131683f5/0xbbfdc9019c1d3e0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265536.587354:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265536.587687:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556877696 00000100:00100000:3.0:1789265536.587701:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556877696 00002000:00100000:3.0:1789265536.587751:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9377507a0000 x1876180556877696/t0(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:107/0 lens 504/0 e 0 to 0 dl 1789265547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265536.587762:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9377507a0000 with x1876180556877696 ext(0->12) 00010000:00010000:3.0:1789265536.587772:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 8 pid: 8436 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.587789:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 8 pid: 8436 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265536.587797:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9377507a0000 00000100:00100000:3.0:1789265536.587820:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:3.0:1789265536.587831:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2400:x1876180556877696:12345-192.168.202.42@tcp:4:lfs.0 00000001:00100000:0.0:1789265536.590549:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f16c02c5-6a63-4180-875a-2aaaca684c23 00000100:00100000:3.0:1789265536.592317:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2400:x1876180556877696:12345-192.168.202.42@tcp:4:lfs.0 Request processed in 4479us (4961us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789265536.592344:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00002000:00100000:3.0:1789265536.592360:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9377507a0000 x1876180556877696/t4294967300(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:107/0 lens 504/448 e 0 to 0 dl 1789265547 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265536.592372:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9377507a0000 with x1876180556877696 ext(0->12) 00010000:00010000:3.0:1789265536.592383:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 9 pid: 8436 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.592403:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 9 pid: 8436 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265536.592412:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9377507a0000 00000100:00100000:3.0:1789265536.605448:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265536.605670:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556877824 00000100:00100000:0.0:1789265536.605682:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556877824 00010000:00010000:0.0:1789265536.605725:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 9 pid: 8436 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265536.605768:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:0.0:1789265536.605778:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f425180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2399:x1876180556877824:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265536.605792:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789265536.605812:0:7460:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789265536.605815:0:7460:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789265537 00002000:00010000:0.0:1789265536.605818:0:7460:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789265537 00002000:00010000:0.0:1789265536.605834:0:7460:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789265537 00002000:00010000:0.0:1789265536.605836:0:7460:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789265536.605843:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 9 pid: 8436 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.605896:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 9 pid: 8436 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.605927:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021825987/0xbbfdc9019c1d3dbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91916e expref: 9 pid: 8436 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.605946:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265536.605951:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265536.605957:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000131683f5/0xbbfdc9019c1d3e0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.605969:0:7460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000131683f5/0xbbfdc9019c1d3e0c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.606013:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265536.606245:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f425180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2399:x1876180556877824:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 292us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265536.606255:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 53 00010000:00010000:2.0:1789265536.607107:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000131683f5/0xbbfdc9019c1d3e0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.607120:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000131683f5/0xbbfdc9019c1d3e0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.607145:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000131683f5/0xbbfdc9019c1d3e0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.607163:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000131683f5/0xbbfdc9019c1d3e0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.607172:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000131683f5/0xbbfdc9019c1d3e0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.607180:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fda00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:2.0:1789265536.607184:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000131683f5/0xbbfdc9019c1d3e0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.607210:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000131683f5/0xbbfdc9019c1d3e0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.607228:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000131683f5/0xbbfdc9019c1d3e0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.607235:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000131683f5/0xbbfdc9019c1d3e0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265536.607318:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556877568:12345-192.168.202.42@tcp:1:lfs.0 Request processed in 38464us (40783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265536.607327:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:3.0:1789265536.631512:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265536.631686:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556878080 00000100:00100000:0.0:1789265536.631697:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556878080 00000100:00100000:0.0:1789265536.631766:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:0.0:1789265536.631777:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+22:11162:x1876180556878080:12345-192.168.202.42@tcp:35:lfs.0 00000004:00010000:0.0:1789265536.631890:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3dfe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91918a expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265536.632350:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1789265536.632401:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789265536.633640:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1789265536.633695:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.633715:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3da3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919160 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.633723:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.633761:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3da3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919160 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.633777:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3da3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919160 expref: 26 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265536.633792:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937747f08380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876180578998400:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265536.633924:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774557f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265536.652721:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265536.653180:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556878208 00000100:00100000:3.0:1789265536.653193:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556878208 00010000:00010000:3.0:1789265536.653240:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3da3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919160 expref: 27 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265536.653291:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:3.0:1789265536.653302:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+27:2400:x1876180556878208:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265536.653317:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265536.653324:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3da3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919160 expref: 27 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.653338:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3da3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919160 expref: 27 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.653374:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820200) 00010000:00010000:3.0:1789265536.653380:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.653389:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.653396:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265536.653416:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265536.653486:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+27:2400:x1876180556878208:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 185us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265536.653494:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 54 00010000:00010000:0.0:1789265536.654165:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d3da3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919160 expref: 26 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265536.654187:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937747f08380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876180578998400:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265536.654216:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.654237:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.654243:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265536.654362:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1789265536.654485:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1789265536.654590:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937747f08380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876180578998528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789265536.654646:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265536.654735:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377612d49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265536.660758:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578998528 00000100:00100000:1.0:1789265536.660774:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578998528 00000100:00100000:1.0:1789265536.660891:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789265536.660904:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1876180578998528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1789265536.661167:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265536.661477:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1876180578998528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 574us (6828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265536.661485:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789265536.661588:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937747f08380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876180578998528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789265536.661795:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1789265536.661906:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937747f08380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876180578998656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789265536.661947:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265536.661981:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377612d43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265536.662210:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578998656 00000100:00100000:1.0:1789265536.662216:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578998656 00000100:00100000:1.0:1789265536.662258:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789265536.662266:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1876180578998656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789265536.662401:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1876180578998656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 135us (453us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789265536.662408:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789265536.662794:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937747f08380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876180578998656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789265536.662845:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1789265536.662928:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.662939:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.662946:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.663145:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265536.663150:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.663160:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.663177:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820200) 00010000:00010000:0.0:1789265536.663180:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789265536.663184:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.663191:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e13 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789265536.663291:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789265536.663357:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789265536.663368:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 392324508346ns, next at 393324506458ns, rc = 0 00000001:00080000:0.0:1789265536.663375:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1789265536.663399:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820200) 00010000:00010000:0.0:1789265536.663402:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789265536.663408:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3dfe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91918a expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265536.663525:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+29:11162:x1876180556878080:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 31749us (32032us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1789265536.663534:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 8 00000020:00080000:0.0:1789265536.663539:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789265536.673423:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265536.676349:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556878336 00000100:00100000:2.0:1789265536.676365:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556878336 00000100:00100000:2.0:1789265536.676442:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:2.0:1789265536.676452:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+29:11162:x1876180556878336:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265536.676482:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265536.677057:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d3e1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919191 expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.677271:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d3e1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919191 expref: 30 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.677287:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d3e1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919191 expref: 30 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265536.677328:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:2.0:1789265536.677331:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265536.677335:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fda00, rc 0) 00000100:00100000:2.0:1789265536.677471:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+30:11162:x1876180556878336:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 1019us (4057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265536.677479:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:1.0:1789265536.694816:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265536.695293:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556878592 00000100:00100000:3.0:1789265536.695305:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556878592 00000100:00100000:3.0:1789265536.695367:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:3.0:1789265536.695378:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779d31450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+30:11162:x1876180556878592:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1789265536.695652:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779d31450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+31:11162:x1876180556878592:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 275us (846us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789265536.695660:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:2.0:1789265536.806648:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265536.806801:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556878848 00000100:00100000:1.0:1789265536.806812:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556878848 00000100:00100000:1.0:1789265536.806909:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:1.0:1789265536.806920:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+31:11173:x1876180556878848:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1789265536.806944:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265536.806967:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3e21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919198 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265536.807112:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789265536.807218:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3e21 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919198 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.807233:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d90300) 00010000:00010000:1.0:1789265536.807235:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265536.807239:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3e21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919198 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.807255:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740030c00, rc 0) 00000100:00100000:1.0:1789265536.807327:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+32:11173:x1876180556878848:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 410us (690us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1789265536.807333:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:1.0:1789265536.823879:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265536.823982:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556878976 00000100:00100000:0.0:1789265536.823994:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556878976 00000100:00100000:0.0:1789265536.824061:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:0.0:1789265536.824090:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+32:11173:x1876180556878976:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:0.0:1789265536.824175:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e2f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824192:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824206:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824219:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3e36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824225:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3e36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824231:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3e36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824308:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824316:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824322:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265536.824370:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824395:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824401:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e2f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824406:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824412:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265536.824417:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824423:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824434:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:0.0:1789265536.824436:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265536.824441:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824447:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3e2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824459:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3e36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824465:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3e36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824471:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3e36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824483:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265536.824486:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3e36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824491:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3e36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824499:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820e00) 00010000:00010000:0.0:1789265536.824501:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265536.824504:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3e36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824509:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3e36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824518:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824524:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824529:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824533:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265536.824535:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824540:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824556:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:0.0:1789265536.824558:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265536.824561:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.824584:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265536.824666:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+32:11173:x1876180556878976:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 595us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265536.824674:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:3.0:1789265536.836524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265536.836699:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556879232 00000100:00100000:2.0:1789265536.836710:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556879232 00000100:00100000:2.0:1789265536.836777:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:2.0:1789265536.836789:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+32:11173:x1876180556879232:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1789265536.837086:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+33:11173:x1876180556879232:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 299us (586us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789265536.837095:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:3.0:1789265536.894981:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265536.895208:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556879488 00000100:00100000:1.0:1789265536.895220:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556879488 00000100:00100000:1.0:1789265536.895290:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:1.0:1789265536.895301:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+33:11176:x1876180556879488:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1789265536.895327:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265536.895349:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3e44 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91919f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895429:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3e4b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895444:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3e4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895469:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3e4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895481:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3e52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895488:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3e52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895493:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3e52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895758:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3e59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895767:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3e59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895774:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3e59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265536.895783:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789265536.895907:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3e4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895915:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3e4b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895921:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3e4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895926:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265536.895937:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3e4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895945:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3e4b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895959:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:1.0:1789265536.895963:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265536.895967:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3e4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895974:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3e4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895991:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3e52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.895998:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3e52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.896003:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3e52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.896009:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265536.896011:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3e52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.896017:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3e52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.896024:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820e00) 00010000:00010000:1.0:1789265536.896026:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265536.896036:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3e52 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.896042:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3e52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.896269:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3e44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91919f expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.896285:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3e59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91919f expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265536.896292:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:1.0:1789265536.896294:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265536.896296:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740030c00, rc 0) 00000100:00100000:1.0:1789265536.896510:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+35:11176:x1876180556879488:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 1201us (1531us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789265536.896519:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:3.0:1789265536.907451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265536.908298:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556879616 00000100:00100000:0.0:1789265536.908309:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556879616 00000100:00100000:0.0:1789265536.908408:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:0.0:1789265536.908420:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+35:11176:x1876180556879616:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:0.0:1789265536.908488:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.908524:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.908536:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.908572:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.908579:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e67 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.908600:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.908606:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265536.908611:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.908619:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.908632:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:0.0:1789265536.908634:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265536.908639:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e67 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265536.908645:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3e67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265536.908725:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+35:11176:x1876180556879616:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 307us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265536.908732:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:3.0:1789265536.914618:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265536.914848:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556879872 00000100:00100000:2.0:1789265536.914875:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556879872 00000100:00100000:2.0:1789265536.914925:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:2.0:1789265536.914932:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+35:11176:x1876180556879872:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1789265536.915350:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+36:11176:x1876180556879872:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 415us (736us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789265536.915358:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:3.0:1789265537.214762:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265537.214975:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556880128 00000100:00100000:2.0:1789265537.214985:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556880128 00000100:00100000:2.0:1789265537.215056:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:2.0:1789265537.215066:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+36:11207:x1876180556880128:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:2.0:1789265537.215117:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265537.215139:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9191a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.215254:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3e75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.215269:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3e75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.215280:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3e75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265537.215291:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789265537.215418:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191a6 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.215438:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3e75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191a6 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.215446:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:2.0:1789265537.215449:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265537.215451:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc400, rc 0) 00000100:00100000:2.0:1789265537.215516:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+38:11207:x1876180556880128:12345-192.168.202.42@tcp:101:cat.0 Request processed in 452us (767us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789265537.215523:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:0.0:1789265537.227706:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265537.227756:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265537.227804:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556880512 00000100:00100000:3.0:1789265537.227815:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556880512 00000100:00100000:2.0:1789265537.227852:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556880384 00000100:00100000:2.0:1789265537.227899:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556880384 00000100:00100000:2.0:1789265537.227943:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:3.0:1789265537.227955:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:3.0:1789265537.227976:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+39:2398:x1876180556880512:12345-192.168.202.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789265537.227984:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+39:11207:x1876180556880384:12345-192.168.202.42@tcp:35:cat.0 00010000:00010000:3.0:1789265537.227996:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265537.228022:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3e75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191a6 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265537.228043:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:3.0:1789265537.228048:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265537.228122:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+38:2398:x1876180556880512:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 157us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265537.228130:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:1.0:1789265537.228743:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+38:11207:x1876180556880384:12345-192.168.202.42@tcp:35:cat.0 Request processed in 761us (1044us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1789265537.228753:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:0.0:1789265537.333650:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265537.333783:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556880768 00000100:00100000:2.0:1789265537.333795:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556880768 00000100:00100000:2.0:1789265537.333914:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:2.0:1789265537.333926:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+38:11213:x1876180556880768:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:2.0:1789265537.334085:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265537.334089:0:9988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789265537.334117:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ddb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91917c expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.334139:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265537.334144:0:9988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265537.334159:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3e83 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9191ad expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.334269:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.334282:0:9988:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3e59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91919f expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.334289:0:9988:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.334335:0:9988:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3e59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91919f expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.334349:0:9988:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3e59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91919f expref: 38 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265537.334379:0:9988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f467480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9988:1876180578998784:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265537.334480:0:9988:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265537.337818:0:9988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f467480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9988:1876180578998784:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265537.337848:0:9988:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265537.338421:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265537.339017:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556880896 00000100:00100000:2.0:1789265537.339025:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556880896 00010000:00010000:2.0:1789265537.339061:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3e59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91919f expref: 39 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265537.339109:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:2.0:1789265537.339119:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+39:2400:x1876180556880896:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265537.339135:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265537.339141:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3e59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91919f expref: 39 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.339151:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3e59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91919f expref: 39 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.339171:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3e59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91919f expref: 39 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.339183:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:2.0:1789265537.339187:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.339194:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.339207:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.339233:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265537.339267:0:9988:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.339277:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265537.339281:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+38:2400:x1876180556880896:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 164us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265537.339292:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 55 00000004:00200000:1.0:1789265537.339304:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789265537.339467:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3e83 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191ad expref: 39 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.339492:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191ad expref: 38 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.339500:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:1.0:1789265537.339503:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265537.339506:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd400, rc 0) 00000100:00100000:1.0:1789265537.339545:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+38:11213:x1876180556880768:12345-192.168.202.42@tcp:101:dd.0 Request processed in 5621us (5955us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789265537.339553:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:1.0:1789265537.351349:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265537.351412:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556881024 00000100:00100000:2.0:1789265537.351424:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556881024 00000100:00100000:2.0:1789265537.351489:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:2.0:1789265537.351509:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+38:11213:x1876180556881024:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:2.0:1789265537.351533:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265537.351553:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3e98 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9191b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.351599:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3e9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.351615:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3e9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.351628:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3e9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.353084:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3e98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191b4 expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.353110:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3e9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191b4 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.353133:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:2.0:1789265537.353136:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265537.353140:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc000, rc 0) 00000100:00100000:2.0:1789265537.353221:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+39:11213:x1876180556881024:12345-192.168.202.42@tcp:101:dd.0 Request processed in 1723us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265537.353229:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:2.0:1789265537.363615:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265537.363693:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556881280 00000100:00100000:3.0:1789265537.363704:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556881280 00000100:00100000:3.0:1789265537.363775:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:3.0:1789265537.363793:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+39:11213:x1876180556881280:12345-192.168.202.42@tcp:36:dd.0 00010000:00010000:3.0:1789265537.364310:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3ea6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265537.364334:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3ea6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265537.364346:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3ea6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265537.364393:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1789265537.364433:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dfdc5f8 reply state 00000000e2935e5f transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3ea6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265537.364446:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3ea6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265537.364454:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:3.0:1789265537.364457:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265537.364461:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265537.364735:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+42:11213:x1876180556881280:12345-192.168.202.42@tcp:36:dd.0 Request processed in 943us (1127us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789265537.364743:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 62 00000020:00080000:3.0:1789265537.364748:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789265537.588972:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265537.654483:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265537.654591:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556881408 00000100:00100000:1.0:1789265537.654603:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556881408 00000100:00100000:1.0:1789265537.654668:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:1.0:1789265537.654678:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+42:11227:x1876180556881408:12345-192.168.202.42@tcp:101:stat.0 00010000:00010000:1.0:1789265537.654703:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265537.654725:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3ead lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9191bb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.654797:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3eb4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.654811:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.654822:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.654845:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3ebb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.654853:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.654897:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.654978:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ec2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.654988:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191ad expref: 43 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.654997:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ec2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.655030:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191ad expref: 43 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.655044:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191ad expref: 43 pid: 9988 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265537.655058:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180578998912:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265537.655166:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f1519c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265537.659259:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265537.659355:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180578998912:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265537.659380:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ec2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265537.659435:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556881664 00000100:00100000:3.0:1789265537.659441:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556881664 00000100:00100000:3.0:1789265537.659490:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:3.0:1789265537.659499:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+44:10785:x1876180556881664:12345-192.168.202.42@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789265537.659821:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+45:10785:x1876180556881664:12345-192.168.202.42@tcp:35:ldlm_bl.0 Request processed in 322us (568us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789265537.659827:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:3.0:1789265537.661783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265537.661885:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556881792 00000100:00100000:0.0:1789265537.661894:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556881792 00010000:00010000:0.0:1789265537.661929:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191ad expref: 45 pid: 9988 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265537.661967:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:0.0:1789265537.661976:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+45:2399:x1876180556881792:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265537.661989:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265537.661995:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191ad expref: 45 pid: 9988 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265537.662008:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191ad expref: 45 pid: 9988 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265537.662029:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3e8a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191ad expref: 45 pid: 9988 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265537.662046:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:0.0:1789265537.662051:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ec2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265537.662060:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265537.662133:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ec2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265537.662218:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265537.662280:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+44:2399:x1876180556881792:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 305us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265537.662301:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 56 00010000:00010000:2.0:1789265537.663273:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663285:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265537.663342:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789265537.663347:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265537.663393:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663408:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663417:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663423:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3eb4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663439:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663445:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265537.663449:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663457:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3eb4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663471:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265537.663474:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265537.663478:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3eb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663484:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3eb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663499:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663507:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3ebb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663512:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3ebb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663517:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265537.663519:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3ebb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663536:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3ebb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663545:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820e00) 00010000:00010000:2.0:1789265537.663548:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265537.663551:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3ebb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663556:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3ebb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663605:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3ead lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191bb expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663619:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191bb expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.663627:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:2.0:1789265537.663630:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265537.663632:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740030e00, rc 0) 00000100:00100000:2.0:1789265537.663733:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+43:11227:x1876180556881408:12345-192.168.202.42@tcp:101:stat.0 Request processed in 9055us (9258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265537.663742:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:3.0:1789265537.736468:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265537.736596:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556882048 00000100:00100000:1.0:1789265537.736607:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556882048 00000100:00100000:1.0:1789265537.736705:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:1.0:1789265537.736717:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+43:11233:x1876180556882048:12345-192.168.202.42@tcp:36:truncate.0 00010000:00010000:1.0:1789265537.736783:0:9988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265537.736818:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3ec2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191bb expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.736840:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:1.0:1789265537.736846:0:9988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265537.737374:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3ec9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.737390:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.737400:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265537.737440:0:9988:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1789265537.737461:0:9988:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0b9bc4c reply state 00000000b14e49b1 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.737472:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3ec9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265537.737479:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:1.0:1789265537.737481:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265537.737484:0:9988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265537.737632:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+45:11233:x1876180556882048:12345-192.168.202.42@tcp:36:truncate.0 Request processed in 907us (1164us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789265537.737640:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 64 00000020:00080000:1.0:1789265537.737656:0:9988:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789265537.909898:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265537.910020:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556882176 00000100:00100000:2.0:1789265537.910031:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556882176 00000100:00100000:2.0:1789265537.910117:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:2.0:1789265537.910130:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+45:11247:x1876180556882176:12345-192.168.202.42@tcp:101:stat.0 00010000:00010000:2.0:1789265537.910173:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265537.910196:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3ed0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9191c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910269:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3ed7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910284:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3ed7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910295:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3ed7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910307:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3ede lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910314:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3ede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910321:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3ede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910393:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3ee5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910402:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910409:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265537.910451:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789265537.910461:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265537.910484:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910497:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910505:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3ed7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910512:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3ed7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910519:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3ed7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910525:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265537.910529:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3ed7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910537:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3ed7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910548:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265537.910551:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265537.910556:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3ed7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910712:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3ed7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910730:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3ede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910746:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3ede lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910752:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3ede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910757:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265537.910760:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3ede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910768:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3ede lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910776:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820e00) 00010000:00010000:2.0:1789265537.910779:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265537.910782:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3ede lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910787:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3ede lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910817:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3ed0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191c2 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910831:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191c2 expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265537.910838:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:2.0:1789265537.910840:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265537.910851:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc400, rc 0) 00000100:00100000:2.0:1789265537.911158:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+46:11247:x1876180556882176:12345-192.168.202.42@tcp:101:stat.0 Request processed in 1029us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265537.911167:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:2.0:1789265538.011922:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265538.012010:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556882432 00000100:00100000:3.0:1789265538.012021:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556882432 00000100:00100000:3.0:1789265538.012129:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:3.0:1789265538.012140:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+46:11257:x1876180556882432:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265538.012167:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265538.012208:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d3eec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9191c9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265538.012334:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789265538.012456:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d3eec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191c9 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.012470:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d90300) 00010000:00010000:3.0:1789265538.012473:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265538.012477:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d3eec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191c9 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.012492:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219a00, rc 0) 00000100:00100000:3.0:1789265538.012565:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+47:11257:x1876180556882432:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 427us (709us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1789265538.012572:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00080000:0.0:1789265538.013212:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265538.017682:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265538.017784:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556882688 00000100:00100000:1.0:1789265538.017794:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556882688 00000100:00100000:1.0:1789265538.017854:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:1.0:1789265538.017899:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+47:11257:x1876180556882688:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:1.0:1789265538.018143:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+48:11257:x1876180556882688:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 247us (468us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1789265538.018151:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:1.0:1789265538.035629:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578999296:0@lo:400:kworker.0 00000100:00100000:1.0:1789265538.035708:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265538.035782:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180578999808:0@lo:400:kworker.0 00000100:00100000:1.0:1789265538.035813:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265538.035832:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180579000320:0@lo:400:kworker.0 00000100:00100000:1.0:1789265538.035854:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265538.035985:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578999168:0@lo:400:kworker.0 00000100:00100000:0.0:1789265538.036045:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578999296 00000100:00100000:0.0:1789265538.036053:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578999296 00000100:00100000:0.0:1789265538.036124:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789265538.036133:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578999296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265538.036190:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180578999296:12345-0@lo:400:kworker.0 Request processed in 59us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265538.036198:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789265538.036357:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180578999296:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.036458:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578999040:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.036496:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265538.036519:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578999552:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.036539:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265538.036554:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579000064:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.036573:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265538.036588:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579000576:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.036607:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265538.036626:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789265538.036632:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578999424:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.036652:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265538.036721:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578999552 00000100:00100000:3.0:1789265538.036726:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578999552 00000100:00100000:3.0:1789265538.036754:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789265538.036761:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578999552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265538.036800:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180578999552:12345-0@lo:400:kworker.0 Request processed in 40us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265538.036806:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789265538.036830:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579000064 00000100:00100000:3.0:1789265538.036834:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579000064 00000100:00100000:3.0:1789265538.036896:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579000576 00000100:00100000:3.0:1789265538.036900:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579000576 00000100:00100000:3.0:1789265538.036938:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789265538.036945:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180579000064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265538.036978:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180579000064:12345-0@lo:400:kworker.0 Request processed in 33us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265538.036984:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789265538.036996:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789265538.037002:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579000576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265538.037030:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579000576:12345-0@lo:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265538.037036:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789265538.037103:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578999040 00000100:00100000:3.0:1789265538.037108:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578999040 00000100:00100000:3.0:1789265538.037136:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789265538.037142:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578999040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265538.037173:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180578999040:12345-0@lo:400:kworker.0 Request processed in 31us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265538.037180:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00080000:3.0:1789265538.037229:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265538.037232:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265538.038846:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578999808 00000100:00100000:0.0:1789265538.038874:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578999808 00000100:00100000:0.0:1789265538.039042:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579000320 00000100:00100000:0.0:1789265538.039047:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579000320 00000100:00080000:3.0:1789265538.039178:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265538.039264:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789265538.039318:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789265538.039417:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578999936:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.039473:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265538.039494:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579000448:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.039515:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265538.039550:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180578999040:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.039586:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180578999552:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.039600:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579000064:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.039612:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579000576:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.039669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265538.039690:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578999680:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.039714:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265538.039727:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180579000192:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.039764:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265538.039797:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578999936 00000100:00100000:2.0:1789265538.039801:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578999936 00000100:00100000:2.0:1789265538.039831:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579000448 00000100:00100000:2.0:1789265538.039834:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579000448 00000100:00100000:2.0:1789265538.039856:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789265538.039893:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578999936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.039950:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180578999936:12345-0@lo:400:kworker.0 Request processed in 71us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.039957:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789265538.039972:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789265538.039979:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579000448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.040006:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579000448:12345-0@lo:400:kworker.0 Request processed in 28us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.040012:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789265538.040047:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180578999936:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.040081:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579000448:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.040134:0:9988:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789265538.040143:0:9988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789265538.040264:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578999424 00000100:00100000:2.0:1789265538.040269:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578999424 00000100:00100000:2.0:1789265538.040290:0:9988:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789265538.040301:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578999168 00000100:00100000:2.0:1789265538.040304:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578999168 00000100:00100000:2.0:1789265538.040320:0:9988:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789265538.040323:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180578999680 00000100:00100000:2.0:1789265538.040325:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180578999680 00000100:00100000:2.0:1789265538.040338:0:9988:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789265538.040344:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579000192 00000100:00100000:2.0:1789265538.040347:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579000192 00000100:00100000:2.0:1789265538.040360:0:9988:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789265538.040367:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789265538.040373:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578999424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.040415:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180578999424:12345-0@lo:400:kworker.0 Request processed in 41us (3761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.040422:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789265538.040434:0:9988:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789265538.040440:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789265538.040446:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578999168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.040478:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180578999168:12345-0@lo:400:kworker.0 Request processed in 32us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.040484:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789265538.040494:0:9988:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789265538.040499:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789265538.040505:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578999680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.040532:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180578999680:12345-0@lo:400:kworker.0 Request processed in 27us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.040538:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789265538.040548:0:9988:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789265538.040554:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789265538.040560:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180579000192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.040597:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180579000192:12345-0@lo:400:kworker.0 Request processed in 37us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.040603:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789265538.040634:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180578999424:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.040661:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180578999168:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.040671:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180578999680:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.040681:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180579000192:0@lo:400:kworker.0 00000100:00080000:3.0:1789265538.043526:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265538.043537:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265538.043540:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265538.043791:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180578999808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265538.043929:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180578999808:12345-0@lo:400:kworker.0 Request processed in 4653us (8114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265538.043939:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789265538.044253:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180579000320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265538.044295:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180579000320:12345-0@lo:400:kworker.0 Request processed in 4971us (8440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265538.044303:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00010000:00080000:2.0:1789265538.046961:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f583100 x1876180578999808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265538.046982:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180578999808:0@lo:400:kworker.0 00010000:00080000:2.0:1789265538.047003:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f581c00 x1876180579000320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265538.047013:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180579000320:0@lo:400:kworker.0 00000100:00100000:2.0:1789265538.091477:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265538.091826:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556882944 00000100:00100000:0.0:1789265538.091839:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556882944 00000100:00100000:0.0:1789265538.092042:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:0.0:1789265538.092055:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+48:11263:x1876180556882944:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1789265538.092095:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265538.092120:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3efa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9191d0 expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.092259:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.092276:0:9988:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3ee5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191c2 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.092285:0:9988:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.092322:0:9988:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191c2 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.092336:0:9988:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3ee5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191c2 expref: 49 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265538.092351:0:9988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937747f09880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9988:1876180579000704:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265538.092437:0:9988:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377612d4840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265538.095650:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265538.095818:0:9988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937747f09880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9988:1876180579000704:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265538.095844:0:9988:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265538.096397:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556883072 00000100:00100000:3.0:1789265538.096405:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556883072 00010000:00010000:3.0:1789265538.096439:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3ee5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191c2 expref: 50 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265538.096530:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:3.0:1789265538.096541:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f67e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+50:2399:x1876180556883072:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265538.096560:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265538.096576:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3ee5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191c2 expref: 50 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.096587:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191c2 expref: 50 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.096610:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3ee5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191c2 expref: 50 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.096629:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:3.0:1789265538.096635:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.096645:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.096653:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.096687:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265538.096763:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f67e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+49:2399:x1876180556883072:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 224us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265538.096769:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 57 00010000:00010000:2.0:1789265538.096845:0:9988:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.096851:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265538.096878:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789265538.097010:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3efa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191d0 expref: 50 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.097030:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191d0 expref: 49 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.097035:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:2.0:1789265538.097037:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265538.097039:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392600, rc 0) 00000100:00100000:2.0:1789265538.097059:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+49:11263:x1876180556882944:12345-192.168.202.42@tcp:101:bash.0 Request processed in 5010us (5593us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789265538.097078:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:3.0:1789265538.100441:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.100824:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556883328 00000100:00100000:2.0:1789265538.100835:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556883328 00000100:00100000:1.0:1789265538.101106:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:1.0:1789265538.101119:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+49:11263:x1876180556883328:12345-192.168.202.42@tcp:36:bash.0 00010000:00010000:1.0:1789265538.101387:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3f0f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.101411:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3f0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.101420:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3f0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265538.101459:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1789265538.101474:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070d2bb8d reply state 00000000ef29c0e8 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3f0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.101483:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3f0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.101488:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:1.0:1789265538.101490:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265538.101493:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265538.102398:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+52:11263:x1876180556883328:12345-192.168.202.42@tcp:36:bash.0 Request processed in 741us (1422us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1789265538.102409:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 68 00000020:00080000:1.0:1789265538.102417:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789265538.109745:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265538.110012:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556883456 00000100:00100000:0.0:1789265538.110023:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556883456 00000100:00100000:0.0:1789265538.110108:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:0.0:1789265538.110119:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+52:11263:x1876180556883456:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1789265538.110148:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265538.110186:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d3f16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9191d7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.110294:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3f1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.110312:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191d0 expref: 53 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.110321:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3f1d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.110358:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191d0 expref: 53 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.110372:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191d0 expref: 53 pid: 9988 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265538.110387:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937747f09880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579000832:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265538.110485:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377612d4840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265538.128119:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265538.128228:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556883584 00000100:00100000:3.0:1789265538.128240:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556883584 00010000:00010000:3.0:1789265538.128303:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191d0 expref: 54 pid: 9988 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265538.128352:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:3.0:1789265538.128363:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+54:2400:x1876180556883584:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265538.128380:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265538.128388:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191d0 expref: 54 pid: 9988 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.128403:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191d0 expref: 54 pid: 9988 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.128425:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:3.0:1789265538.128430:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3f1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.128440:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.128447:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3f1d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.128471:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265538.128536:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+54:2400:x1876180556883584:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 175us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265538.128544:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 58 00010000:00010000:0.0:1789265538.133103:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f01 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191d0 expref: 53 pid: 9988 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265538.133135:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937747f09880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579000832:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265538.133163:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.133174:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.133203:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265538.137205:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789265538.137219:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265538.137259:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.137317:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d3f16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191d7 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.137339:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3f1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191d7 expref: 52 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.137349:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:0.0:1789265538.137352:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265538.137356:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393200, rc 0) 00000100:00100000:0.0:1789265538.137438:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+52:11263:x1876180556883456:12345-192.168.202.42@tcp:101:bash.0 Request processed in 27320us (27704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265538.137446:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:2.0:1789265538.144276:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265538.145903:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556883840 00000100:00100000:1.0:1789265538.145918:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556883840 00000100:00100000:1.0:1789265538.146036:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:1.0:1789265538.146047:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779d32050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+52:11263:x1876180556883840:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:1.0:1789265538.146343:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779d32050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+53:11263:x1876180556883840:12345-192.168.202.42@tcp:35:bash.0 Request processed in 297us (2079us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789265538.146350:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:3.0:1789265538.230235:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.230359:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556884096 00000100:00100000:2.0:1789265538.230368:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556884096 00000100:00100000:2.0:1789265538.230443:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:2.0:1789265538.230452:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764362ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+53:11273:x1876180556884096:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265538.230472:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265538.230488:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3f24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9191de expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265538.230618:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789265538.230718:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3f24 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191de expref: 55 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.230733:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d90300) 00010000:00010000:2.0:1789265538.230742:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265538.230747:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3f24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191de expref: 55 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.230761:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd600, rc 0) 00000100:00100000:2.0:1789265538.230827:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764362ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+54:11273:x1876180556884096:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 376us (600us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1789265538.230834:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:2.0:1789265538.232928:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265538.233048:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556884224 00000100:00100000:1.0:1789265538.233057:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556884224 00000100:00100000:1.0:1789265538.233147:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:1.0:1789265538.233156:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+54:11273:x1876180556884224:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:1.0:1789265538.233228:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3f32 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233244:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3f32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233254:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3f32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233263:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3f39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233267:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3f39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233271:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3f39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233334:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233339:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233343:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265538.233377:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233399:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3f32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233403:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3f32 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233408:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3f32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233411:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265538.233414:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3f32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233419:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3f32 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233428:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:1.0:1789265538.233430:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265538.233433:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3f32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233436:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3f32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233445:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3f39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233449:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3f39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233452:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3f39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233459:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265538.233461:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3f39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233464:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3f39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233469:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820e00) 00010000:00010000:1.0:1789265538.233470:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265538.233472:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3f39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233475:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3f39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233482:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233485:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233488:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233492:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030e00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265538.233494:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233500:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233518:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:1.0:1789265538.233520:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265538.233523:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.233528:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265538.233625:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+54:11273:x1876180556884224:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 469us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265538.233630:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:1.0:1789265538.235278:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265538.235340:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556884480 00000100:00100000:3.0:1789265538.235347:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556884480 00000100:00100000:3.0:1789265538.235431:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:3.0:1789265538.235441:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+54:11273:x1876180556884480:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1789265538.235673:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+55:11273:x1876180556884480:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 234us (400us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789265538.235681:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:3.0:1789265538.255970:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265538.256048:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556884736 00000100:00100000:0.0:1789265538.256056:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556884736 00000100:00100000:0.0:1789265538.256221:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 72 00000100:00100000:0.0:1789265538.256233:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+55:11276:x1876180556884736:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1789265538.256257:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265538.256274:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d3f47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9191e5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256351:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f4e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256361:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256369:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256376:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3f55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256380:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3f55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256384:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3f55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256470:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3f5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256475:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3f5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256479:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3f5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265538.256486:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789265538.256567:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256575:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f4e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256588:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256594:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265538.256598:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256606:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256618:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:0.0:1789265538.256622:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265538.256626:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256632:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3f4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256645:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3f55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256650:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3f55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256655:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3f55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256659:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265538.256662:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3f55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256676:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3f55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256684:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820e00) 00010000:00010000:0.0:1789265538.256687:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265538.256690:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3f55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256695:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3f55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256730:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d3f47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191e5 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256742:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3f5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191e5 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.256748:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:0.0:1789265538.256750:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265538.256752:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393c00, rc 0) 00000100:00100000:0.0:1789265538.256822:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+57:11276:x1876180556884736:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 591us (859us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789265538.256829:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 72 00000100:00100000:2.0:1789265538.259538:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265538.259641:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556884864 00000100:00100000:0.0:1789265538.259651:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556884864 00000100:00100000:0.0:1789265538.259743:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 73 00000100:00100000:0.0:1789265538.259755:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+57:11276:x1876180556884864:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:0.0:1789265538.259836:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.259852:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.259895:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.259928:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.259934:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.259942:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.259948:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265538.259952:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.259959:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.259970:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:0.0:1789265538.259972:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265538.259976:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.259983:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265538.260074:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+57:11276:x1876180556884864:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 322us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265538.260082:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 73 00000100:00100000:1.0:1789265538.264576:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265538.264664:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265538.264742:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556885248 00000100:00100000:0.0:1789265538.264753:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556885248 00000100:00100000:0.0:1789265538.264894:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:0.0:1789265538.264902:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+57:2400:x1876180556885248:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265538.264916:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265538.264936:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3f5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191e5 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.264951:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:0.0:1789265538.264955:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265538.265002:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+56:2400:x1876180556885248:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 102us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265538.265007:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:3.0:1789265538.265147:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556885120 00000100:00100000:3.0:1789265538.265152:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556885120 00000100:00100000:3.0:1789265538.265190:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:3.0:1789265538.265197:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+56:11276:x1876180556885120:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1789265538.265451:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+57:11276:x1876180556885120:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 254us (884us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789265538.265459:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:1.0:1789265538.420434:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.421136:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556885504 00000100:00100000:2.0:1789265538.421151:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556885504 00000100:00100000:2.0:1789265538.421285:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 74 00000100:00100000:2.0:1789265538.421299:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+57:11294:x1876180556885504:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:2.0:1789265538.421333:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265538.421363:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3f71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9191ec expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.421513:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3f78 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.421528:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3f78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.421543:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3f78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265538.421555:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789265538.422425:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3f71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191ec expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.422465:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3f78 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191ec expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.422474:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:2.0:1789265538.422477:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789265538.422481:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc200, rc 0) 00000100:00100000:2.0:1789265538.422696:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+59:11294:x1876180556885504:12345-192.168.202.42@tcp:101:cat.0 Request processed in 1398us (2271us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1789265538.422704:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 74 00000100:00100000:1.0:1789265538.468110:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265538.468255:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556885632 00000100:00100000:0.0:1789265538.468266:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556885632 00000100:00100000:0.0:1789265538.468339:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 75 00000100:00100000:0.0:1789265538.468351:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+59:11295:x1876180556885632:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1789265538.468380:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265538.468405:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3f86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9191f3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.468481:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.468512:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.468524:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265538.468576:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789265538.468580:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265538.468599:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.468628:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d3f86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191f3 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.468646:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191f3 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.468655:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:0.0:1789265538.468657:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265538.468661:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392c00, rc 0) 00000100:00100000:0.0:1789265538.468732:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+60:11295:x1876180556885632:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 384us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265538.468740:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 75 00000100:00100000:1.0:1789265538.479943:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265538.480208:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556886016 00000100:00100000:3.0:1789265538.480219:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556886016 00000100:00100000:3.0:1789265538.480279:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:3.0:1789265538.480292:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+60:11295:x1876180556886016:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1789265538.480906:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+61:11295:x1876180556886016:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 615us (973us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789265538.480916:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:1.0:1789265538.490961:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265538.491145:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556886144 00000100:00100000:3.0:1789265538.491155:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556886144 00000100:00100000:3.0:1789265538.491288:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:3.0:1789265538.491300:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+61:11295:x1876180556886144:12345-192.168.202.42@tcp:103:lfs.0 00010000:00010000:3.0:1789265538.491335:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789265538.491362:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d3f1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191d7 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.491383:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d3f78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191ec expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.491396:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d3e1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919191 expref: 59 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.491407:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:3.0:1789265538.491412:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265538.491475:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+58:11295:x1876180556886144:12345-192.168.202.42@tcp:103:lfs.0 Request processed in 177us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265538.491483:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:0.0:1789265538.496905:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265538.497046:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556886272 00000100:00100000:1.0:1789265538.497132:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556886272 00000100:00100000:1.0:1789265538.497193:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 76 00000100:00100000:1.0:1789265538.497203:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+58:11295:x1876180556886272:12345-192.168.202.42@tcp:58:lfs.0 00010000:00010000:1.0:1789265538.497352:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f94 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.497370:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.497381:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265538.498284:0:9988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265538.498449:0:9988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789265538.498849:0:9988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789265538.499303:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+58:11295:x1876180556886272:12345-192.168.202.42@tcp:58:lfs.0 Request processed in 2094us (2402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265538.499316:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 76 00000100:00100000:1.0:1789265538.525798:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.525908:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556886400 00000100:00100000:2.0:1789265538.525919:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556886400 00000100:00100000:2.0:1789265538.525988:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 77 00000100:00100000:2.0:1789265538.525998:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+58:11297:x1876180556886400:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265538.526019:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265538.526041:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3f9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9191fa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526137:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fa2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526155:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fa2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526167:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fa2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526179:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3fa9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526189:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526194:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526256:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3fb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526262:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526266:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265538.526300:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789265538.526303:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265538.526317:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526326:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526332:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fa2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526336:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fa2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526340:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fa2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526351:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265538.526354:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fa2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526359:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fa2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526368:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265538.526370:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265538.526373:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fa2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526377:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fa2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526387:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526391:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3fa9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526395:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526397:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265538.526399:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526402:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526412:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820e00) 00010000:00010000:2.0:1789265538.526414:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265538.526416:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3fa9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526420:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3fa9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526444:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d3f9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191fa expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526460:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191fa expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.526468:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:2.0:1789265538.526470:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265538.526472:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd600, rc 0) 00000100:00100000:2.0:1789265538.526539:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+59:11297:x1876180556886400:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 542us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.526548:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 77 00000100:00100000:2.0:1789265538.547437:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579000960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265538.547523:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265538.547726:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579000960 00000100:00100000:0.0:1789265538.547738:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579000960 00000100:00100000:0.0:1789265538.547799:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789265538.547811:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579000960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265538.547895:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265538.547948:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579000960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265538.547957:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789265538.548054:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579000960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265538.548306:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265538.548317:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937747f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579001088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265538.548347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265538.548426:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579001088 00000100:00100000:2.0:1789265538.548431:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579001088 00000100:00100000:2.0:1789265538.548467:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789265538.548475:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579001088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265538.548486:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265538.548541:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579001088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.548548:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789265538.548624:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937747f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579001088:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265538.613316:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265538.679421:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265538.679432:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265538.679466:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789265538.679479:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265538.679703:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1876180579001216:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789265538.679812:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f151b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265538.693165:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1876180579001216:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789265538.695201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.696087:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556886528 00000100:00100000:2.0:1789265538.696100:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556886528 00000100:00100000:2.0:1789265538.696168:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 78 00000100:00100000:2.0:1789265538.696180:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+59:11308:x1876180556886528:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789265538.696213:0:14174:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789265538.696336:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+59:11308:x1876180556886528:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 158us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.696345:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 78 00000001:00080000:2.0:1789265538.707471:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:2.0:1789265538.707540:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789265538.707560:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9377612d4b40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789265538.707566:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff937743544300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9377612d49c0 00000020:00080000:2.0:1789265538.707569:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff937743544b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9377810af600 00000100:00100000:2.0:1789265538.707688:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265538.707712:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579001344:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789265538.707785:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265538.707848:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579001344 00000100:00100000:2.0:1789265538.707856:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579001344 00000100:00100000:2.0:1789265538.707927:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265538.707938:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180579001344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789265538.707974:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1789265538.708020:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa60681, atime: 0x6aa60681, ctime: 0x6aa60681, blocks: 0x8 00010000:00010000:2.0:1789265538.708029:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac5f00e1/0xbbfdc9019c1d3fb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.708046:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1789265538.708050:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265538.708065:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac5f00e1/0xbbfdc9019c1d3fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.708081:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac5f00e1/0xbbfdc9019c1d3fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.708091:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac5f00e1/0xbbfdc9019c1d3fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.708100:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac5f00e1/0xbbfdc9019c1d3fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.708119:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789265538.708261:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1876180579001344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 325us (476us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789265538.708268:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1789265538.708294:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265538.708300:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac5f00e1/0xbbfdc9019c1d3fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.708308:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc400 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:2.0:1789265538.708319:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac5f00e1/0xbbfdc9019c1d3fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.708330:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac5f00e1/0xbbfdc9019c1d3fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.708347:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac5f00e1/0xbbfdc9019c1d3fb7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.708354:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac5f00e1/0xbbfdc9019c1d3fb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.708371:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265538.708373:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265538.708374:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789265538.708405:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93777f585500/2, rc 0, transno 4294967302 00000100:00100000:2.0:1789265538.708411:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579001344:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789265538.708490:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708500:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d56 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708507:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708519:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265538.708524:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708530:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d56 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708542:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff937779d90e00) 00010000:00010000:1.0:1789265538.708545:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265538.708549:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d56 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708555:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031400/0xbbfdc9019c1d3d56 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708571:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708577:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d5d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708583:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708589:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265538.708592:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708598:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d5d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708619:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:1.0:1789265538.708621:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265538.708624:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d5d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708629:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031c00/0xbbfdc9019c1d3d5d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708643:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3d9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708649:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3d9c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708655:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3d9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708661:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fde00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265538.708664:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3d9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708669:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3d9c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708677:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820e00) 00010000:00010000:1.0:1789265538.708679:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265538.708682:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3d9c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708689:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d3d9c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708719:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3ea6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708726:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3ea6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708732:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3ea6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708737:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643218a00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265538.708741:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3ea6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708747:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3ea6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708757:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:1.0:1789265538.708760:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265538.708763:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3ea6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708768:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d3ea6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708788:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3ec9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708795:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3ec9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708801:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3ec9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708813:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265538.708817:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3ec9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789265538.708824:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:1.0:1789265538.708825:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3ec9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708843:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:1.0:1789265538.708845:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265538.708848:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3ec9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708854:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030600/0xbbfdc9019c1d3ec9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708891:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3f0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708896:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3f0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708902:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3f0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708906:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265538.708908:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3f0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708914:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3f0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708933:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:1.0:1789265538.708936:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265538.708939:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3f0f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.708945:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d3f0f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265538.710357:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000020:00080000:3.0:1789265538.711000:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789265538.719496:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556886656 00000100:00100000:1.0:1789265538.719512:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556886656 00000100:00100000:1.0:1789265538.719588:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 79 00000100:00100000:1.0:1789265538.720176:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+12:11308:x1876180556886656:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789265538.720260:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3fbe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720278:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3fbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720291:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3fbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720307:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3fc5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720315:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720322:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720372:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d3fcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720380:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d3fcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720386:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d3fcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265538.720436:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789265538.720441:0:9988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265538.720457:0:9988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d3fcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720468:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3fbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720474:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3fbe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720480:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3fbe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720486:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265538.720491:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3fbe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720499:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3fbe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720512:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93774712f300) 00010000:00010000:1.0:1789265538.720522:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265538.720528:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3fbe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720534:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d3fbe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720550:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720557:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3fc5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720562:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720567:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265538.720570:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720575:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3fc5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720583:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff937779d90400) 00010000:00010000:1.0:1789265538.720585:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265538.720588:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3fc5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720594:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d3fc5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720611:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d3fcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720623:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d3fcc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720629:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d3fcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720634:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265538.720637:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d3fcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720643:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d3fcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720652:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:1.0:1789265538.720654:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265538.720657:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d3fcc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.720663:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d3fcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265538.722610:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+12:11308:x1876180556886656:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 Request processed in 2429us (12245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265538.722625:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 79 00000100:00100000:1.0:1789265538.741672:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.742665:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556886912 00000100:00100000:2.0:1789265538.742679:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556886912 00000100:00100000:2.0:1789265538.743216:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 80 00000100:00100000:2.0:1789265538.747963:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+12:11308:x1876180556886912:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265538.747995:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265538.748016:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3fd3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919201 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.748149:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fda lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.748171:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.748183:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265538.748196:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789265538.748292:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.748300:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.748307:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.748313:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265538.748317:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.748325:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.748338:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:2.0:1789265538.748341:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265538.748345:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fda lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.748351:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d3fda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.748394:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3fd3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919201 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.748411:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93774712f300) 00010000:00010000:2.0:1789265538.748414:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265538.748418:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3fd3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919201 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.748428:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd800, rc 0) 00000100:00100000:2.0:1789265538.748503:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+13:11308:x1876180556886912:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 5271us (6841us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1789265538.748512:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 80 00000100:00100000:2.0:1789265538.756992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265538.759821:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556887040 00000100:00100000:3.0:1789265538.759835:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556887040 00000100:00100000:3.0:1789265538.759918:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 81 00000100:00100000:3.0:1789265538.759928:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+13:11308:x1876180556887040:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265538.759963:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265538.760107:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+13:11308:x1876180556887040:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 179us (3123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265538.760114:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 81 00000100:00100000:3.0:1789265538.766030:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265538.766235:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556887296 00000100:00100000:0.0:1789265538.766246:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556887296 00000100:00100000:0.0:1789265538.766306:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 82 00000100:00100000:0.0:1789265538.766318:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+13:11308:x1876180556887296:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265538.766338:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265538.766341:0:9988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789265538.766369:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d3f8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191f3 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.766388:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:0.0:1789265538.766393:0:9988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265538.766405:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3fe8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919208 expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789265538.766809:0:9988:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789265538.767001:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3fef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.767014:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3fef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.767024:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3fef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.767083:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d3fe8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919208 expref: 15 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.767106:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3fef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919208 expref: 14 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.767115:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93774712fa00) 00010000:00010000:0.0:1789265538.767117:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265538.767120:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393800, rc 0) 00000100:00100000:0.0:1789265538.767190:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+14:11308:x1876180556887296:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 875us (1170us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789265538.767197:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 82 00000100:00100000:3.0:1789265538.775020:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.776401:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556887552 00000100:00100000:2.0:1789265538.776413:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556887552 00000100:00100000:2.0:1789265538.776479:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 83 00000100:00100000:2.0:1789265538.776489:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+14:11308:x1876180556887552:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265538.776548:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265538.776576:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d3fef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919208 expref: 14 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776592:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93774712fa00) 00010000:00010000:2.0:1789265538.776603:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265538.776625:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3ffd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776637:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3ffd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776659:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3ffd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776674:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4004 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x43e3232 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776681:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4004 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x43e3232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776688:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4004 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x43e3232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776738:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3ffd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776746:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3ffd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776752:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3ffd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776757:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265538.776761:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3ffd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776768:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3ffd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776776:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265538.776779:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265538.776782:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3ffd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776793:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d3ffd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776815:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4004 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x43e3232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776821:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4004 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x43e3232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776827:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4004 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x43e3232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776832:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265538.776835:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4004 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x43e3232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776841:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4004 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x43e3232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776848:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x43e3232 (ffff937777820c00) 00010000:00010000:2.0:1789265538.776851:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265538.776853:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4004 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x43e3232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.776888:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4004 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x43e3232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265538.776976:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+13:11308:x1876180556887552:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 488us (1965us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265538.776984:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 83 00000100:00100000:3.0:1789265538.781076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265538.781120:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556887680 00000100:00100000:1.0:1789265538.781130:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556887680 00000100:00100000:1.0:1789265538.781185:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 84 00000100:00100000:1.0:1789265538.781197:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+13:11308:x1876180556887680:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265538.781228:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265538.781254:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d400b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91920f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.781291:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4012 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.781304:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.781315:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.781422:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d400b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91920f expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.781438:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91920f expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.781446:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff937779d90400) 00010000:00010000:1.0:1789265538.781448:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265538.781452:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc600, rc 0) 00000100:00100000:1.0:1789265538.781650:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+14:11308:x1876180556887680:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 454us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265538.781658:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 84 00000100:00100000:1.0:1789265538.792889:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.793371:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556887936 00000100:00100000:2.0:1789265538.793381:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556887936 00000100:00100000:2.0:1789265538.793447:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 85 00000100:00100000:2.0:1789265538.793458:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+14:11308:x1876180556887936:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265538.793937:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4019 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.793954:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4019 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.793965:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4019 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265538.794164:0:9988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1789265538.794175:0:9988:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394455315211ns, next at 395455312598ns, rc = 0 00000004:00010000:2.0:1789265538.794231:0:9988:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f935733d reply state 00000000f07d438c transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4019 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.794245:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4019 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.794253:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff937779d90400) 00010000:00010000:2.0:1789265538.794256:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789265538.794259:0:9988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265538.794385:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+16:11308:x1876180556887936:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 926us (1545us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789265538.794394:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 85 00000100:00100000:3.0:1789265538.797991:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265538.798119:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556888064 00000100:00100000:1.0:1789265538.798129:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556888064 00000100:00100000:1.0:1789265538.798191:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 86 00000100:00100000:1.0:1789265538.798212:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+16:11308:x1876180556888064:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265538.798237:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265538.798255:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4020 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919216 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.798311:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4020 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919216 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.798325:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4020 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919216 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.798342:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff937779d90400) 00010000:00010000:1.0:1789265538.798345:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265538.798349:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd200, rc 0) 00000100:00100000:1.0:1789265538.798419:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+17:11308:x1876180556888064:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 209us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265538.798426:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 86 00000100:00100000:2.0:1789265538.828427:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.828485:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.828512:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556888448 00000100:00100000:2.0:1789265538.828535:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556888448 00000100:00100000:3.0:1789265538.828555:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556888192 00000100:00100000:3.0:1789265538.828560:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556888192 00000100:00100000:2.0:1789265538.828588:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 386 00000100:00100000:3.0:1789265538.828595:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:2.0:1789265538.828597:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2397:x1876180556888448:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265538.828600:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1876180556888192:12345-192.168.202.42@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789265538.828627:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp t0 exp 0000000000000000 cur 394 last 0 00000020:00000080:3.0:1789265538.828662:0:8436:0:(genops.c:1385:class_connect()) connect: client f16c02c5-6a63-4180-875a-2aaaca684c23, cookie 0xbbfdc9019c1d4027 00000100:00100000:2.0:1789265538.828665:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2397:x1876180556888448:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.828672:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 386 00002000:00100000:3.0:1789265538.828674:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f16c02c5-6a63-4180-875a-2aaaca684c23/ffff93777f39d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789265538.828683:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00000100:00100000:2.0:1789265538.828713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.828733:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556888704 00000100:00100000:2.0:1789265538.828736:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556888704 00002000:00080000:3.0:1789265538.828759:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1789265538.828767:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 143 00000100:00100000:2.0:1789265538.828773:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377813b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2397:x1876180556888704:12345-192.168.202.42@tcp:400:kworker.0 00000100:00080000:3.0:1789265538.828786:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9376436fd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265538.828797:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377813b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2397:x1876180556888704:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 25us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.828803:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 143 00000100:00100000:3.0:1789265538.828808:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2396:x1876180556888192:12345-192.168.202.42@tcp:8:lhsmtool_posix.0 Request processed in 207us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265538.828814:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:2.0:1789265538.828887:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.828909:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556888960 00000100:00100000:2.0:1789265538.828913:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556888960 00000100:00100000:2.0:1789265538.828942:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 297 00000100:00100000:2.0:1789265538.828949:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556888960:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265538.828976:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556888960:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.828982:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 297 00000100:00100000:2.0:1789265538.829020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.829036:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556888576 00000100:00100000:2.0:1789265538.829039:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556888576 00000100:00100000:2.0:1789265538.829073:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 298 00000100:00100000:2.0:1789265538.829086:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556888576:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265538.829111:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2397:x1876180556888576:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 25us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.829117:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 298 00000100:00100000:2.0:1789265538.829176:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00080000:3.0:1789265538.829279:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265538.829284:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265538.829291:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556888832 00000100:00100000:3.0:1789265538.829295:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556888832 00000100:00100000:3.0:1789265538.829503:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 299 00000100:00100000:3.0:1789265538.829510:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556888832:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265538.829544:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2397:x1876180556888832:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 34us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265538.829550:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 299 00000100:00080000:2.0:1789265538.830319:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265538.841457:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265538.841533:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556888320 00000100:00100000:0.0:1789265538.841543:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556888320 00000100:00080000:2.0:1789265538.841646:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265538.841683:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:0.0:1789265538.841692:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:0:x1876180556888320:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00000001:00080000:2.0:1789265538.844484:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:2.0:1789265538.844496:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f16c02c5-6a63-4180-875a-2aaaca684c23 00000100:00100000:0.0:1789265538.845019:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:0:x1876180556888320:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 3320us (3565us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789265538.845030:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:3.0:1789265538.849532:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265538.850196:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556889216 00000100:00100000:0.0:1789265538.850208:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556889216 00000100:00100000:0.0:1789265538.850270:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:0.0:1789265538.850280:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+17:11308:x1876180556889216:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789265538.850510:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+18:11308:x1876180556889216:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 230us (986us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789265538.850518:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:3.0:1789265538.856330:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.856415:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556889472 00000100:00100000:2.0:1789265538.856426:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556889472 00000100:00100000:2.0:1789265538.856487:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 87 00000100:00100000:2.0:1789265538.856497:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+18:11308:x1876180556889472:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265538.856608:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+18:11308:x1876180556889472:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 112us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.856616:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 87 00000100:00100000:2.0:1789265538.870793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265538.871030:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556889600 00000100:00100000:3.0:1789265538.871041:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556889600 00000100:00100000:3.0:1789265538.871119:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 88 00000100:00100000:3.0:1789265538.871129:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+18:11308:x1876180556889600:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265538.871149:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265538.871167:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d402e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91921d expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.871260:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4035 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.871275:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.871287:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265538.871340:0:14174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265538.871363:0:14174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.871390:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d402e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91921d expref: 20 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.871406:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4035 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91921d expref: 19 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.871414:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff937779d90400) 00010000:00010000:3.0:1789265538.871417:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789265538.871428:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643218200, rc 0) 00000100:00100000:3.0:1789265538.871498:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+19:11308:x1876180556889600:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 370us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265538.871504:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 88 00000100:00100000:0.0:1789265538.886611:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265538.888376:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556889728 00000100:00100000:3.0:1789265538.888390:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556889728 00000100:00100000:3.0:1789265538.888464:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:3.0:1789265538.888476:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556889728:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265538.888496:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265538.888522:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021825987/0xbbfdc9019c1d403c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919224 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265538.888556:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa60683, blocks: 0x0 00010000:00010000:3.0:1789265538.888587:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1789265538.888592:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265538.888602:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021825987/0xbbfdc9019c1d403c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919224 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.888623:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021825987/0xbbfdc9019c1d403c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919224 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.888638:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219a00, rc 0) 00000100:00100000:3.0:1789265538.888719:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2399:x1876180556889728:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 245us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265538.888727:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:3.0:1789265538.893134:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265538.893449:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556889984 00000100:00100000:1.0:1789265538.893459:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556889984 00000100:00100000:1.0:1789265538.893518:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 89 00000100:00100000:1.0:1789265538.893528:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+19:11308:x1876180556889984:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789265538.893649:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+19:11308:x1876180556889984:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 123us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265538.893657:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 89 00000100:00100000:0.0:1789265538.904325:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265538.904418:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556890112 00000100:00100000:1.0:1789265538.904429:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556890112 00000100:00100000:1.0:1789265538.904506:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:1.0:1789265538.904517:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:11308:x1876180556890112:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265538.904537:0:9789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265538.904556:0:9789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b812cff6/0xbbfdc9019c1d4043 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91922b expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.904600:0:9789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021825987/0xbbfdc9019c1d403c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919224 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.904610:0:9789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265538.904614:0:9789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265538.904620:0:9789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b812cff6/0xbbfdc9019c1d4043 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91922b expref: 7 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.904658:0:9789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021825987/0xbbfdc9019c1d403c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919224 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.904671:0:9789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021825987/0xbbfdc9019c1d403c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919224 expref: 7 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265538.904686:0:9789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9789:1876180579001472:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265538.904782:0:9789:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f1519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265538.912082:0:9789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9789:1876180579001472:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265538.912123:0:9789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b812cff6/0xbbfdc9019c1d4043 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91922b expref: 7 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.912148:0:9789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc200, rc 0) 00000100:00100000:0.0:1789265538.912224:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+7:11308:x1876180556890112:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 7708us (7908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265538.912233:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:0.0:1789265538.914562:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265538.914714:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556890240 00000100:00100000:3.0:1789265538.914724:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556890240 00010000:00010000:3.0:1789265538.914763:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021825987/0xbbfdc9019c1d403c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919224 expref: 7 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265538.914807:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:3.0:1789265538.914818:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2400:x1876180556890240:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265538.914831:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265538.914852:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021825987/0xbbfdc9019c1d403c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919224 expref: 7 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.914884:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021825987/0xbbfdc9019c1d403c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919224 expref: 7 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.914907:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021825987/0xbbfdc9019c1d403c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919224 expref: 7 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.914921:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265538.914925:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265538.914932:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b812cff6/0xbbfdc9019c1d4043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91922b expref: 6 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.914940:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b812cff6/0xbbfdc9019c1d4043 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91922b expref: 6 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.914974:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b812cff6/0xbbfdc9019c1d4043 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91922b expref: 6 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265538.914998:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1876180579001600:192.168.202.42@tcp:105: 00000100:00100000:3.0:1789265538.915090:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265538.926803:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.926828:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1876180579001600:192.168.202.42@tcp:105: 00010000:00010000:2.0:1789265538.926854:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265538.926973:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556890240:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 12155us (12418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265538.926983:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:0.0:1789265538.927321:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556890368 00000100:00100000:0.0:1789265538.927329:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556890368 00002000:00100000:0.0:1789265538.927374:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9376435a8700 x1876180556890368/t0(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:109/0 lens 504/0 e 0 to 0 dl 1789265549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265538.927384:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9376435a8700 with x1876180556890368 ext(0->8) 00002000:00010000:0.0:1789265538.927389:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9376435a8700 00000100:00100000:0.0:1789265538.927412:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:0.0:1789265538.927421:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556890368:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789265538.928440:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2400:x1876180556890368:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 Request processed in 1012us (1637us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789265538.928451:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00002000:00100000:0.0:1789265538.928460:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9376435a8700 x1876180556890368/t4294967303(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:109/0 lens 504/448 e 0 to 0 dl 1789265549 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265538.928469:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9376435a8700 with x1876180556890368 ext(0->8) 00002000:00010000:0.0:1789265538.928481:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9376435a8700 00000100:00100000:3.0:1789265538.932635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.932730:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556890496 00000100:00100000:2.0:1789265538.932741:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556890496 00000100:00100000:2.0:1789265538.932803:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 90 00000100:00100000:2.0:1789265538.932825:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+19:11308:x1876180556890496:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789265538.934804:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1789265538.934818:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789265538.934847:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1789265538.935014:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+15:11308:x1876180556890496:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 Request processed in 2187us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265538.935024:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 90 00000020:00080000:3.0:1789265538.935227:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1789265538.935239:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789265538.935246:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265538.935264:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579001728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789265538.935314:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265538.935358:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579001728 00000100:00100000:3.0:1789265538.935365:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579001728 00000100:00100000:3.0:1789265538.935401:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265538.935408:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579001728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789265538.935518:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789265538.935522:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789265540 00002000:00010000:3.0:1789265538.935524:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789265538.935527:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789265539 -> 1789265540 00002000:00010000:3.0:1789265538.935529:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789265538.935563:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876180579001728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (247us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789265538.935571:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1789265538.935611:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9376435aa680/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789265538.935617:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579001728:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789265538.936029:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4019 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.936040:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4019 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.936048:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4019 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.936070:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265538.936075:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4019 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.936083:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4019 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.936100:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff937779d90400) 00010000:00010000:2.0:1789265538.936103:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789265538.936108:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4019 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.936115:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4019 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265538.938303:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265538.938436:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556890624 00000100:00100000:0.0:1789265538.938446:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556890624 00000100:00100000:0.0:1789265538.938508:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:0.0:1789265538.938518:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2397:x1876180556890624:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789265538.940620:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1789265538.940647:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1789265538.940821:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2397:x1876180556890624:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 Request processed in 2299us (2521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265538.940832:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:3.0:1789265538.947378:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265538.947470:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556890880 00000100:00100000:0.0:1789265538.947483:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556890880 00000100:00100000:0.0:1789265538.947551:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 91 00000100:00100000:0.0:1789265538.947565:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+14:11308:x1876180556890880:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789265538.947628:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265538.947655:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4035 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91921d expref: 14 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.947676:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff937779d90400) 00010000:00010000:0.0:1789265538.947681:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265538.947711:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d404a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.947742:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d404a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.947754:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d404a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265538.947916:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7ae4647 reply state 000000006efa0f1d transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d404a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.947931:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d404a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.947938:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff937779d90400) 00010000:00010000:0.0:1789265538.947941:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789265538.947943:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265538.948044:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+15:11308:x1876180556890880:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 482us (676us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789265538.948052:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 91 00000100:00100000:3.0:1789265538.951167:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265538.951352:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556891008 00000100:00100000:0.0:1789265538.951363:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556891008 00000100:00100000:0.0:1789265538.951416:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:0.0:1789265538.951426:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556891008:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789265538.951584:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789265538.951587:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789265540 -> 1789265539 00002000:00010000:0.0:1789265538.951590:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789265537 00002000:00010000:0.0:1789265538.951592:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789265540 -> 1789265539 00002000:00010000:0.0:1789265538.951595:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789265538.951661:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2400:x1876180556891008:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 236us (503us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789265538.951683:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:0.0:1789265538.963305:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.966364:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556891264 00000100:00100000:2.0:1789265538.966383:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556891264 00000100:00100000:2.0:1789265538.966991:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 92 00000100:00100000:2.0:1789265538.967005:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+15:11308:x1876180556891264:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789265538.967102:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.967130:0:9988:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4012 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91920f expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.967138:0:9988:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.967176:0:9988:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91920f expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265538.967190:0:9988:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4012 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91920f expref: 15 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265538.967206:0:9988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f587800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9988:1876180579001856:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265538.967302:0:9988:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265538.972314:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265538.972556:0:9988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f587800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9988:1876180579001856:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265538.972589:0:9988:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265538.973932:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556891392 00000100:00100000:1.0:1789265538.973944:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556891392 00010000:00010000:1.0:1789265538.973990:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4012 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91920f expref: 16 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265538.974042:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:1.0:1789265538.974069:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+16:2400:x1876180556891392:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265538.974084:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265538.974092:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4012 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91920f expref: 16 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.974104:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91920f expref: 16 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.974126:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91920f expref: 16 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.974142:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff937779d90400) 00010000:00010000:1.0:1789265538.974147:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.974156:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.974163:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.974186:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265538.974240:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+15:2400:x1876180556891392:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 173us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265538.974247:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 60 00010000:00010000:1.0:1789265538.974278:0:9988:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.974291:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.974328:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.974336:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.974343:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.974349:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265538.974353:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.974361:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.974370:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff937779d90400) 00010000:00010000:1.0:1789265538.974373:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789265538.974376:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.974381:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4051 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265538.974420:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+14:11308:x1876180556891264:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 Request processed in 7419us (11123us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789265538.974428:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 92 00000100:00100000:3.0:1789265538.982925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265538.988160:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556891520 00000100:00100000:0.0:1789265538.988174:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556891520 00000100:00100000:0.0:1789265538.988232:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:0.0:1789265538.988242:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556891520:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789265538.988282:0:9789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007390bbc6/0xbbfdc9019c1d4058 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.988302:0:9789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b812cff6/0xbbfdc9019c1d4043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91922b expref: 7 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.988311:0:9789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265538.988315:0:9789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265538.988320:0:9789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007390bbc6/0xbbfdc9019c1d4058 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.988352:0:9789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b812cff6/0xbbfdc9019c1d4043 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91922b expref: 7 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265538.988365:0:9789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b812cff6/0xbbfdc9019c1d4043 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91922b expref: 7 pid: 9789 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265538.988379:0:9789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937747f09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9789:1876180579001984:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265538.988466:0:9789:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774557fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265538.993099:0:9789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937747f09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9789:1876180579001984:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265538.993137:0:9789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007390bbc6/0xbbfdc9019c1d4058 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265538.994319:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265538.995766:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556891648 00000100:00100000:1.0:1789265538.995779:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556891648 00010000:00010000:1.0:1789265538.995820:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b812cff6/0xbbfdc9019c1d4043 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91922b expref: 8 pid: 9789 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265538.995883:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:1.0:1789265538.995893:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2400:x1876180556891648:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265538.995907:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265538.995929:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b812cff6/0xbbfdc9019c1d4043 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91922b expref: 8 pid: 9789 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.995943:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b812cff6/0xbbfdc9019c1d4043 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91922b expref: 8 pid: 9789 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.995967:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b812cff6/0xbbfdc9019c1d4043 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91922b expref: 8 pid: 9789 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.995981:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265538.995986:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265538.995992:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007390bbc6/0xbbfdc9019c1d4058 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.996013:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007390bbc6/0xbbfdc9019c1d4058 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265538.996049:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265538.996118:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2400:x1876180556891648:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 227us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265538.996126:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 61 00010000:00010000:3.0:1789265538.996154:0:9789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007390bbc6/0xbbfdc9019c1d4058 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.996165:0:9789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007390bbc6/0xbbfdc9019c1d4058 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.996185:0:9789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007390bbc6/0xbbfdc9019c1d4058 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.996193:0:9789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007390bbc6/0xbbfdc9019c1d4058 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.996200:0:9789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007390bbc6/0xbbfdc9019c1d4058 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.996207:0:9789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392e00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265538.996211:0:9789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007390bbc6/0xbbfdc9019c1d4058 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.996219:0:9789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007390bbc6/0xbbfdc9019c1d4058 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.996244:0:9789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007390bbc6/0xbbfdc9019c1d4058 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.996251:0:9789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007390bbc6/0xbbfdc9019c1d4058 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265538.996316:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2399:x1876180556891520:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 Request processed in 8075us (13396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265538.996325:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:3.0:1789265539.001365:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265539.002803:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556891904 00000100:00100000:1.0:1789265539.002816:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556891904 00000100:00100000:1.0:1789265539.002901:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 93 00000100:00100000:1.0:1789265539.002913:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+14:11308:x1876180556891904:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789265539.002995:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.003012:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3e9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191b4 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.003022:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.003076:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3e9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191b4 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.003091:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3e9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191b4 expref: 14 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265539.003107:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876180579002112:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265539.003216:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377451233c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265539.011325:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876180579002112:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265539.011354:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265539.020388:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265539.020971:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556892032 00000100:00100000:3.0:1789265539.020982:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556892032 00010000:00010000:3.0:1789265539.021021:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3e9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191b4 expref: 15 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265539.021077:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:3.0:1789265539.021086:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377583dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+15:2399:x1876180556892032:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265539.021101:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265539.021108:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3e9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191b4 expref: 15 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.021122:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3e9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191b4 expref: 15 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.021144:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d3e9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191b4 expref: 15 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.021173:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:3.0:1789265539.021178:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.021187:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.021194:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.021219:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265539.021278:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377583dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+14:2399:x1876180556892032:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 193us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265539.021286:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 62 00010000:00010000:1.0:1789265539.021994:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.022005:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.022204:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.022218:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4020 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919216 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.022227:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.022259:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4020 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919216 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.022272:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4020 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919216 expref: 14 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265539.022287:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876180579002240:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265539.022366:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745123240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265539.032254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265539.032293:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556892160 00000100:00100000:1.0:1789265539.032303:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556892160 00010000:00010000:1.0:1789265539.032352:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4020 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919216 expref: 15 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265539.032400:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:1.0:1789265539.032414:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+15:2399:x1876180556892160:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265539.032431:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265539.032442:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4020 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919216 expref: 15 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.032460:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4020 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919216 expref: 15 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.032488:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff937779d90400) 00010000:00010000:1.0:1789265539.032495:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.032507:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.032516:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.032539:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265539.032628:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+15:2399:x1876180556892160:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 218us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265539.032639:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 63 00010000:00010000:1.0:1789265539.032768:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4020 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919216 expref: 14 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265539.032784:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876180579002240:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265539.032803:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.032811:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.032817:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265539.032954:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1789265539.033083:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1789265539.033121:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1789265539.033207:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180579002368:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789265539.033252:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265539.033278:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff93777a3ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265539.033295:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579002368 00000100:00100000:1.0:1789265539.033299:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579002368 00000100:00100000:1.0:1789265539.033332:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789265539.033339:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1876180579002368:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789265539.033414:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1876180579002368:12345-0@lo:1000:mdt00_001.0 Request processed in 74us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265539.033421:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789265539.033452:0:6520:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789265539.033457:0:6520:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9376435aa680, transno 4294967304 00000100:00100000:1.0:1789265539.033469:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180579002368:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789265539.033580:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1789265539.033615:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180579002496:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789265539.033640:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265539.033656:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377451230c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265539.033728:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579002496 00000100:00100000:1.0:1789265539.033732:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579002496 00000100:00100000:1.0:1789265539.033756:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789265539.033763:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1876180579002496:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789265539.033850:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1876180579002496:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (209us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789265539.033880:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789265539.033912:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1876180579002496:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789265539.033939:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.033946:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.033953:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.033959:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265539.033964:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.033971:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.033984:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff937779d90400) 00010000:00010000:1.0:1789265539.033994:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265539.034000:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.034007:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4066 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.034034:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.034040:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f94 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.034045:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f94 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.034050:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030e00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265539.034066:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f94 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.034072:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f94 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.034080:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:1.0:1789265539.034082:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265539.034085:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f94 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.034090:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d3f94 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.034113:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.034134:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3fb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191fa expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.034142:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.034163:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191fa expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.034176:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3fb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191fa expref: 17 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265539.034187:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876180579002624:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265539.034249:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff93777a3ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265539.041692:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876180579002624:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265539.041723:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265539.042535:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265539.043101:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556892288 00000100:00100000:0.0:1789265539.043111:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556892288 00010000:00010000:0.0:1789265539.043151:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3fb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191fa expref: 18 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265539.043190:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:0.0:1789265539.043200:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f422300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+18:2399:x1876180556892288:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265539.043217:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265539.043224:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3fb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191fa expref: 18 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043238:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191fa expref: 18 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043259:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d3fb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9191fa expref: 18 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043277:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:0.0:1789265539.043283:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043293:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043301:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043337:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265539.043388:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f422300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+17:2399:x1876180556892288:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 189us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265539.043396:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 64 00010000:00010000:0.0:1789265539.043422:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043429:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043441:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043447:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043453:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043458:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265539.043462:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043470:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043479:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:0.0:1789265539.043482:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265539.043486:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043502:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d406d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043513:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043519:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043525:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043530:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bda00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265539.043533:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043539:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043547:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820400) 00010000:00010000:0.0:1789265539.043550:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789265539.043553:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.043558:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d405f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265539.043704:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+16:11308:x1876180556891904:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 40793us (42348us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789265539.043712:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 93 00000020:00080000:0.0:1789265539.043722:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789265539.044392:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265539.044398:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265539.044427:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789265539.044434:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265539.052332:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265539.052361:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556892544 00000100:00100000:3.0:1789265539.052370:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556892544 00000100:00100000:3.0:1789265539.052412:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:3.0:1789265539.052421:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+16:11308:x1876180556892544:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789265539.052674:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789265539.052706:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1789265539.052736:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4074 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.052751:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4074 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.052762:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4074 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.052781:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4074 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.052788:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4074 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.052794:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4074 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.052808:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789265539.052906:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+18:11308:x1876180556892544:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 485us (582us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789265539.052914:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000020:00080000:3.0:1789265539.052919:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789265539.052939:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265539.052945:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4074 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.052952:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167fc00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265539.052957:0:13735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4074 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.052965:0:13735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4074 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.052977:0:13735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff937779d90400) 00010000:00010000:3.0:1789265539.052980:0:13735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789265539.052984:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4074 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.052999:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4074 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.053012:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265539.053013:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265539.053015:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265539.309415:0:14212:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265539.309425:0:14212:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265539.309458:0:14212:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789265539.309466:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265539.536379:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265539.536448:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556892800 00000100:00100000:3.0:1789265539.536458:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556892800 00000100:00100000:3.0:1789265539.536525:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 94 00000100:00100000:3.0:1789265539.536536:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+18:11318:x1876180556892800:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265539.536561:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265539.536597:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d407b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919232 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.536712:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4082 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.536727:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4082 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.536740:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4082 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265539.536751:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789265539.537221:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d407b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919232 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.537243:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4082 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919232 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265539.537270:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:3.0:1789265539.537273:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265539.537277:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93774167fc00, rc 0) 00000100:00100000:3.0:1789265539.537350:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+20:11318:x1876180556892800:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 815us (980us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789265539.537357:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 94 00000100:00100000:3.0:1789265539.550477:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265539.550559:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556892928 00000100:00100000:1.0:1789265539.550571:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556892928 00000100:00100000:1.0:1789265539.550638:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 95 00000100:00100000:1.0:1789265539.550650:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+20:11318:x1876180556892928:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:1.0:1789265539.550734:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4090 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.550769:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4090 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.550781:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4090 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.550798:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4097 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.550805:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.550811:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.550939:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d409e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.550947:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d409e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.550954:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d409e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265539.550999:0:9988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d409e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551012:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4090 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551019:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4090 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551035:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4090 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551041:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265539.551046:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4090 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551064:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4090 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551079:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:1.0:1789265539.551082:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265539.551087:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4090 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551093:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d4090 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551108:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551115:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4097 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551120:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551126:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265539.551128:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551145:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4097 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551154:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937779d90900) 00010000:00010000:1.0:1789265539.551156:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265539.551159:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4097 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551164:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4097 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551180:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d409e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551186:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d409e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551193:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d409e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551198:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bde00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265539.551201:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d409e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551207:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d409e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551213:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937779d90b00) 00010000:00010000:1.0:1789265539.551216:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265539.551218:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d409e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.551233:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d409e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265539.551325:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+20:11318:x1876180556892928:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 677us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265539.551333:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 95 00000100:00100000:3.0:1789265539.572272:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265539.572298:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579002752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265539.572366:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265539.572431:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579002752 00000100:00100000:3.0:1789265539.572439:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579002752 00000100:00100000:3.0:1789265539.572488:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789265539.572497:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579002752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265539.572532:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789265539.572744:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579002752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 246us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265539.572752:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789265539.572803:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579002752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265539.573368:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265539.573380:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579002880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265539.573418:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265539.573450:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579002880 00000100:00100000:1.0:1789265539.573454:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579002880 00000100:00100000:1.0:1789265539.573482:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789265539.573488:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579002880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265539.573512:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265539.573543:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579002880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265539.573550:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789265539.573594:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579002880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265539.626380:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265539.626565:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556893184 00000100:00100000:2.0:1789265539.626576:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556893184 00000100:00100000:2.0:1789265539.626639:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 96 00000100:00100000:2.0:1789265539.626649:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+20:11321:x1876180556893184:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265539.626670:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265539.626718:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919239 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.626790:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d40ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.626805:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d40ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.626815:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d40ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.626825:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.626829:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.626833:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.626960:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d40ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.626966:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d40ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.626970:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d40ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265539.626976:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789265539.627036:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d40ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627062:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d40ac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627069:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d40ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627074:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fda00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265539.627078:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d40ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627268:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d40ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627278:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265539.627280:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265539.627284:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d40ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627288:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d40ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627298:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627302:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627305:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627308:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265539.627315:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627320:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627324:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820500) 00010000:00010000:2.0:1789265539.627326:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265539.627327:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627330:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627360:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919239 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627370:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d40ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919239 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.627375:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:2.0:1789265539.627377:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265539.627378:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc400, rc 0) 00000100:00100000:2.0:1789265539.627433:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+22:11321:x1876180556893184:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 785us (1061us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789265539.627440:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 96 00000100:00100000:3.0:1789265539.631409:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265539.632480:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556893312 00000100:00100000:1.0:1789265539.632492:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556893312 00000100:00100000:1.0:1789265539.632547:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 97 00000100:00100000:1.0:1789265539.632554:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+22:11321:x1876180556893312:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:1.0:1789265539.632635:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d40c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.632648:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d40c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.632670:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d40c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.632709:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d40c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.632714:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d40c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.632719:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d40c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.632722:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bde00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265539.632725:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d40c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.632730:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d40c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.632738:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:1.0:1789265539.632740:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265539.632743:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d40c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.632747:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d40c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265539.632814:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+22:11321:x1876180556893312:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 260us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265539.632819:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 97 00010000:00010000:2.0:1789265539.635077:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265539.636245:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265539.636336:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556893568 00000100:00100000:0.0:1789265539.636347:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556893568 00000100:00100000:0.0:1789265539.636413:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:0.0:1789265539.636423:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779d31c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+22:11321:x1876180556893568:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:0.0:1789265539.636663:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779d31c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+23:11321:x1876180556893568:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 241us (423us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1789265539.636672:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:0.0:1789265539.664295:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265539.664444:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556893824 00000100:00100000:2.0:1789265539.664455:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556893824 00000100:00100000:2.0:1789265539.664518:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 98 00000100:00100000:2.0:1789265539.664539:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+23:10846:x1876180556893824:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1789265539.664567:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265539.664599:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40cf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.664714:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.664730:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d40ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919239 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.664740:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.664778:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d40ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919239 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.664791:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d40ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919239 expref: 24 pid: 6520 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265539.664806:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f587800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579003008:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265539.664946:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff937761554840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265539.669401:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f587800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579003008:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265539.669434:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265539.670379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265539.670435:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556893952 00000100:00100000:1.0:1789265539.670452:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556893952 00010000:00010000:1.0:1789265539.670490:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d40ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919239 expref: 25 pid: 6520 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265539.670536:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:1.0:1789265539.670547:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+25:2399:x1876180556893952:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265539.670573:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265539.670581:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d40ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919239 expref: 25 pid: 6520 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.670595:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d40ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919239 expref: 25 pid: 6520 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.670618:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d40ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919239 expref: 25 pid: 6520 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.670636:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:1.0:1789265539.670642:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.670651:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.670658:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.670689:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265539.670746:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+24:2399:x1876180556893952:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 201us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265539.670764:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 65 00010000:00010000:0.0:1789265539.671128:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.671137:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265539.671161:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789265539.671297:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919240 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.671314:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919240 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.671321:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:0.0:1789265539.671324:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789265539.671326:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd800, rc 0) 00000100:00100000:0.0:1789265539.671368:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+24:10846:x1876180556893824:12345-192.168.202.42@tcp:101:bash.0 Request processed in 6832us (7084us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1789265539.671386:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 98 00000100:00100000:0.0:1789265539.676303:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265539.676745:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556894080 00000100:00100000:2.0:1789265539.676756:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556894080 00000100:00100000:2.0:1789265539.676843:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 99 00000100:00100000:2.0:1789265539.676854:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+24:10846:x1876180556894080:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1789265539.676928:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265539.676954:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d40e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919247 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.676989:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d40eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.677002:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d40eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.677014:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d40eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.677145:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d40e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919247 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.677164:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d40eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919247 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.677173:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:2.0:1789265539.677176:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265539.677180:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fde00, rc 0) 00000100:00100000:2.0:1789265539.677474:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+25:10846:x1876180556894080:12345-192.168.202.42@tcp:101:bash.0 Request processed in 621us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265539.677481:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 99 00000100:00100000:1.0:1789265539.681831:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265539.682113:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556894336 00000100:00100000:2.0:1789265539.682127:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556894336 00000100:00100000:2.0:1789265539.682198:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 100 00000100:00100000:2.0:1789265539.682210:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+25:10846:x1876180556894336:12345-192.168.202.42@tcp:36:bash.0 00010000:00010000:2.0:1789265539.682426:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.682443:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.682454:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265539.682490:0:9988:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1789265539.682511:0:9988:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef7b8c31 reply state 00000000e302678c transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.682523:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.682530:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:2.0:1789265539.682533:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265539.682535:0:9988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789265539.682566:0:9988:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1789265539.684204:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+29:10846:x1876180556894336:12345-192.168.202.42@tcp:36:bash.0 Request processed in 1984us (2373us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789265539.684215:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 100 00000020:00080000:2.0:1789265539.684223:0:9988:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789265539.687194:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265539.687284:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556894464 00000100:00100000:0.0:1789265539.687294:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556894464 00000100:00100000:0.0:1789265539.687396:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 101 00000100:00100000:0.0:1789265539.687407:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+29:10846:x1876180556894464:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1789265539.687433:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265539.687454:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d40f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91924e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.687513:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d40f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91924e expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.687528:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d40f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91924e expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.687547:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:0.0:1789265539.687549:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265539.687553:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392c00, rc 0) 00000100:00100000:0.0:1789265539.687616:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+30:10846:x1876180556894464:12345-192.168.202.42@tcp:101:bash.0 Request processed in 210us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265539.687624:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 101 00000100:00100000:3.0:1789265539.690945:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265539.691229:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556894592 00000100:00100000:1.0:1789265539.691239:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556894592 00000100:00100000:1.0:1789265539.691302:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:1.0:1789265539.691312:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:10846:x1876180556894592:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1789265539.691330:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265539.691350:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4100 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919255 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265539.691376:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa60683, atime: 0x6aa60681, ctime: 0x6aa60683, blocks: 0x8 00010000:00010000:1.0:1789265539.691398:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789265539.691403:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265539.691411:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4100 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919255 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.691430:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4100 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919255 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265539.691444:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc600, rc 0) 00000100:00100000:1.0:1789265539.691514:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:10846:x1876180556894592:12345-192.168.202.42@tcp:101:bash.0 Request processed in 203us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265539.691521:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:1.0:1789265539.693948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265539.694031:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556894720 00000100:00100000:3.0:1789265539.694039:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556894720 00002000:00010000:3.0:1789265539.694107:0:8439:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1789265539.694112:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93777f420e00 with x1876180556894720 ext(0->18446744073709551615) 00002000:00010000:3.0:1789265539.694123:0:8439:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93777f420e00. 00000100:00100000:3.0:1789265539.694159:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:3.0:1789265539.694169:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2397:x1876180556894720:12345-192.168.202.42@tcp:10:bash.0 00002000:00010000:3.0:1789265539.694440:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789265539.694444:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789265539 -> 1789265540 00002000:00010000:3.0:1789265539.694447:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789265537 -> 1789265537 00002000:00010000:3.0:1789265539.694449:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789265539 -> 1789265540 00002000:00010000:3.0:1789265539.694451:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1789265539.694518:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2397:x1876180556894720:12345-192.168.202.42@tcp:10:bash.0 Request processed in 350us (579us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789265539.694526:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 1 00002000:00010000:3.0:1789265539.694530:0:8439:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1789265539.694533:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93777f420e00 with x1876180556894720 ext(0->18446744073709551615) 00002000:00010000:3.0:1789265539.694537:0:8439:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93777f420e00. 00000100:00100000:2.0:1789265539.791979:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265539.792465:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556894848 00000100:00100000:0.0:1789265539.792476:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556894848 00000100:00100000:0.0:1789265539.792553:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 102 00000100:00100000:0.0:1789265539.792577:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+30:11335:x1876180556894848:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:0.0:1789265539.792683:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4107 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.792701:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4107 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.792712:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4107 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.792728:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d410e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.792735:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d410e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.792742:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d410e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.792825:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4115 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.792833:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.792840:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789265539.793177:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793191:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4107 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793209:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4107 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793215:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4107 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793221:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392e00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265539.793226:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4107 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793233:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4107 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793247:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:0.0:1789265539.793250:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265539.793255:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4107 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793262:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4107 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793276:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d410e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793281:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d410e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793286:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d410e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793290:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265539.793299:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d410e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793305:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d410e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793312:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937779d97600) 00010000:00010000:0.0:1789265539.793315:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265539.793318:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d410e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793323:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d410e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793338:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793344:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4115 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793348:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4115 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793352:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265539.793354:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4115 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793359:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4115 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793365:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:0.0:1789265539.793367:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265539.793375:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4115 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.793380:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4115 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265539.793458:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+30:11335:x1876180556894848:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 894us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265539.793465:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 102 00000100:00100000:1.0:1789265539.846482:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265539.846612:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556895104 00000100:00100000:2.0:1789265539.846623:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556895104 00000100:00100000:2.0:1789265539.846688:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 103 00000100:00100000:2.0:1789265539.846699:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+30:11338:x1876180556895104:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265539.846730:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265539.846751:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d411c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91925c expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.846841:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4123 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.846856:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4123 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.846904:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4123 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.846921:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d412a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.846928:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d412a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.846934:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d412a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847169:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4131 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847180:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847187:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265539.847198:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789265539.847291:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4123 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847299:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4123 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847305:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4123 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847312:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265539.847316:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4123 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847324:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4123 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847338:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265539.847342:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265539.847347:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4123 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847353:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4123 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847369:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d412a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847374:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d412a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847379:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d412a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847384:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fdc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265539.847392:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d412a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847398:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d412a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847405:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820500) 00010000:00010000:2.0:1789265539.847407:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265539.847410:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d412a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847415:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d412a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847456:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d411c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91925c expref: 33 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847471:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4131 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91925c expref: 32 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.847478:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:2.0:1789265539.847480:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789265539.847482:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc000, rc 0) 00000100:00100000:2.0:1789265539.847664:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+32:11338:x1876180556895104:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 965us (1190us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789265539.847672:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 103 00000100:00100000:1.0:1789265539.854759:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265539.854900:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556895232 00000100:00100000:0.0:1789265539.854910:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556895232 00000100:00100000:0.0:1789265539.854966:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 104 00000100:00100000:0.0:1789265539.854975:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+32:11338:x1876180556895232:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:0.0:1789265539.855040:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.855071:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919240 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.855080:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.855115:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919240 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.855128:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919240 expref: 32 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265539.855144:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937747f0a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579003136:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265539.855251:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774831fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265539.859135:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265539.859419:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556895488 00000100:00100000:1.0:1789265539.859429:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556895488 00000100:00100000:1.0:1789265539.859487:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:1.0:1789265539.859500:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+33:6171:x1876180556895488:12345-192.168.202.42@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789265539.859836:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+34:6171:x1876180556895488:12345-192.168.202.42@tcp:35:ldlm_bl.0 Request processed in 338us (711us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789265539.859845:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:0.0:1789265539.861917:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937747f0a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579003136:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265539.861953:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265539.862962:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265539.863163:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556895616 00000100:00100000:0.0:1789265539.863172:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556895616 00010000:00010000:0.0:1789265539.863213:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919240 expref: 34 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265539.863294:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:0.0:1789265539.863304:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+34:2400:x1876180556895616:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265539.863320:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265539.863327:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919240 expref: 34 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.863339:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919240 expref: 34 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.863362:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d40d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919240 expref: 34 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.863379:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:0.0:1789265539.863384:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.863394:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.863420:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.863453:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265539.863514:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+33:2400:x1876180556895616:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 211us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265539.863522:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 66 00010000:00010000:2.0:1789265539.864079:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.864089:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.864141:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.864148:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.864154:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.864160:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265539.864165:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.864174:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.864184:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:2.0:1789265539.864187:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265539.864190:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265539.864195:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d413f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265539.864253:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+32:11338:x1876180556895232:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 9277us (9506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265539.864261:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 104 00000100:00100000:3.0:1789265539.867072:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265539.868250:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556895872 00000100:00100000:2.0:1789265539.868265:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556895872 00000100:00100000:2.0:1789265539.868327:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:2.0:1789265539.868352:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+32:11338:x1876180556895872:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1789265539.868710:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+33:11338:x1876180556895872:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 358us (1646us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789265539.868719:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:2.0:1789265539.975283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265539.975387:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556896128 00000100:00100000:0.0:1789265539.975398:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556896128 00000100:00100000:0.0:1789265539.975470:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 105 00000100:00100000:0.0:1789265539.975482:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+33:11349:x1876180556896128:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:0.0:1789265539.975510:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265539.975535:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4146 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919263 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.975624:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d414d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.975641:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d414d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.975654:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d414d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.975669:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4154 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.975676:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.975702:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.975826:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d415b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.975836:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d415b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.975843:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d415b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265539.975853:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1789265539.975979:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d414d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.975988:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d414d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.975995:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d414d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.976001:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392e00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265539.976006:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d414d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.976013:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d414d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.976027:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:0.0:1789265539.976030:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265539.976312:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d414d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.976321:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d414d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.976337:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.976343:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4154 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.976348:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.976354:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265539.976356:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.976362:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4154 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.976371:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937779d97600) 00010000:00010000:0.0:1789265539.976374:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265539.976376:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4154 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.976382:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4154 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.976427:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4146 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919263 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.976454:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d415b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919263 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265539.976462:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:0.0:1789265539.976464:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265539.976467:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392600, rc 0) 00000100:00100000:0.0:1789265539.976544:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+35:11349:x1876180556896128:12345-192.168.202.42@tcp:101:cat.0 Request processed in 1064us (1272us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789265539.976552:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 105 00000100:00100000:3.0:1789265539.982965:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265539.983163:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556896384 00000100:00100000:2.0:1789265539.983174:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556896384 00000100:00100000:2.0:1789265539.983227:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:2.0:1789265539.983237:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+35:11349:x1876180556896384:12345-192.168.202.42@tcp:35:cat.0 00000100:00100000:2.0:1789265539.983539:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+36:11349:x1876180556896384:12345-192.168.202.42@tcp:35:cat.0 Request processed in 302us (583us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789265539.983547:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:3.0:1789265540.010786:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265540.010950:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556896640 00000100:00100000:2.0:1789265540.010962:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556896640 00000100:00100000:2.0:1789265540.011057:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 106 00000100:00100000:2.0:1789265540.011068:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+36:11350:x1876180556896640:12345-192.168.202.42@tcp:36:rm.0 00010000:00010000:2.0:1789265540.011128:0:9988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789265540.011158:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d40f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91924e expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011181:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d415b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919263 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011193:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4131 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91925c expref: 34 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011228:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d40eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919247 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011239:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:2.0:1789265540.011243:0:9988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265540.011266:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4169 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011281:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4169 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011291:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4169 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011304:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4170 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011310:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4170 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011317:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4170 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011400:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4177 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011409:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4177 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011415:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4177 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265540.011667:0:9988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1789265540.011679:0:9988:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 395672819051ns, next at 396672815882ns, rc = 0 00010000:00010000:2.0:1789265540.011733:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d417e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011742:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d417e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011751:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d417e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011758:0:9988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d417e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011765:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d417e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011771:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d417e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011807:0:9988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265540.011827:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4177 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011832:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4177 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011838:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4177 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011843:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265540.011855:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4177 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011916:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4177 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011926:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:2.0:1789265540.011929:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789265540.011932:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4177 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011939:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4177 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011954:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4169 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011961:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4169 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011966:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4169 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011970:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fdc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265540.011973:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4169 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011978:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4169 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.011985:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265540.011987:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265540.011996:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4169 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.012001:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4169 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265540.012010:0:9988:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031482d31 reply state 00000000e1bf62b3 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4170 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.012020:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4170 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.012025:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820500) 00010000:00010000:2.0:1789265540.012027:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265540.012029:0:9988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265540.012125:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+34:11350:x1876180556896640:12345-192.168.202.42@tcp:36:rm.0 Request processed in 1056us (1348us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789265540.012133:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 106 00010000:00010000:1.0:1789265540.012470:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265540.012478:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d417e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.012484:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd800 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265540.012488:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d417e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.012495:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d417e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.012506:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:1.0:1789265540.012508:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789265540.012511:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d417e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.012517:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d417e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.012528:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265540.012529:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265540.012539:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789265540.012784:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265540.083297:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579003264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265540.083380:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265540.083482:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579003264 00000100:00100000:3.0:1789265540.083490:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579003264 00000100:00100000:3.0:1789265540.083545:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789265540.083583:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876180579003264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265540.083615:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265540.083666:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876180579003264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265540.083674:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1789265540.083697:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265540.083731:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579003264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265540.084077:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579003392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265540.084112:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265540.084349:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579003392 00000100:00100000:0.0:1789265540.084355:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579003392 00000100:00100000:0.0:1789265540.084403:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789265540.084410:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579003392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265540.084426:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265540.084465:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579003392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265540.084472:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789265540.084507:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579003392:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789265540.084763:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265540.085854:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265540.086078:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556896896 00000100:00100000:2.0:1789265540.086086:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556896896 00000100:00100000:2.0:1789265540.086141:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 107 00000100:00100000:2.0:1789265540.086151:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+34:11356:x1876180556896896:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1789265540.086174:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265540.086197:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4185 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91926a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.086307:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d418c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.086322:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d418c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.086350:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d418c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.086362:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d4193 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.086369:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d4193 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.086375:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d4193 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265540.086736:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789265540.086914:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d419a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.086924:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d419a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.086931:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d419a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.086960:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d418c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.086967:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d418c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.086973:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d418c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.086978:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265540.086989:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d418c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.086996:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d418c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.087008:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265540.087011:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265540.087015:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d418c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.087021:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d418c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265540.087035:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c9b9b8c reply state 0000000029bceeeb transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d4193 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.087060:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d4193 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.087067:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820500) 00010000:00010000:2.0:1789265540.087068:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265540.087071:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789265540.087098:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4185 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91926a expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.087112:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d419a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91926a expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.087119:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820c00) 00010000:00010000:2.0:1789265540.087121:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265540.087129:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc000, rc 0) 00000100:00100000:2.0:1789265540.087200:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+37:11356:x1876180556896896:12345-192.168.202.42@tcp:101:bash.0 Request processed in 1050us (1352us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789265540.087208:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 107 00000100:00100000:3.0:1789265540.092668:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265540.092762:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556897024 00000100:00100000:0.0:1789265540.092773:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556897024 00000100:00100000:0.0:1789265540.092854:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:0.0:1789265540.092911:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2398:x1876180556897024:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1789265540.092931:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265540.092968:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051100174/0xbbfdc9019c1d41a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919271 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265540.092996:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265540.093020:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=395s v=(0 0) 00010000:00010000:0.0:1789265540.093024:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265540.093034:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051100174/0xbbfdc9019c1d41a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919271 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.093083:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051100174/0xbbfdc9019c1d41a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919271 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.093097:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393800, rc 0) 00000100:00100000:0.0:1789265540.093156:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2398:x1876180556897024:12345-192.168.202.42@tcp:101:bash.0 Request processed in 252us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265540.093164:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00080000:1.0:1789265540.093635:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265540.100248:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265540.100362:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556897152 00000100:00100000:1.0:1789265540.100373:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556897152 00000100:00100000:1.0:1789265540.100433:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:1.0:1789265540.100444:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+8:11356:x1876180556897152:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1789265540.100463:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265540.100486:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919278 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.100518:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051100174/0xbbfdc9019c1d41a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919271 expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.100527:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265540.100532:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265540.100538:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.100572:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051100174/0xbbfdc9019c1d41a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919271 expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.100587:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051100174/0xbbfdc9019c1d41a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919271 expref: 9 pid: 8434 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265540.100622:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1876180579003520:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265540.100732:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745562e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265540.104412:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1876180579003520:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265540.104451:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.104474:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bde00, rc 0) 00000100:00100000:1.0:1789265540.104536:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+9:11356:x1876180556897152:12345-192.168.202.42@tcp:101:bash.0 Request processed in 4094us (4298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265540.104545:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:2.0:1789265540.106809:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265540.106914:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556897280 00000100:00100000:1.0:1789265540.106924:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556897280 00010000:00010000:1.0:1789265540.106965:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051100174/0xbbfdc9019c1d41a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919271 expref: 9 pid: 8434 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265540.107010:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:1.0:1789265540.107021:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f586a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2400:x1876180556897280:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265540.107036:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265540.107074:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051100174/0xbbfdc9019c1d41a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919271 expref: 9 pid: 8434 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.107089:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051100174/0xbbfdc9019c1d41a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919271 expref: 9 pid: 8434 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.107136:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051100174/0xbbfdc9019c1d41a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919271 expref: 9 pid: 8434 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.107154:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265540.107158:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265540.107166:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.107175:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.107216:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265540.107232:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1876180579003648:192.168.202.42@tcp:105: 00000100:00100000:1.0:1789265540.107328:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745562e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265540.111814:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265540.111982:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1876180579003648:192.168.202.42@tcp:105: 00010000:00010000:1.0:1789265540.112005:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265540.112084:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f586a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2400:x1876180556897280:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 5064us (5283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265540.112094:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:2.0:1789265540.112292:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556897536 00000100:00100000:2.0:1789265540.112300:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556897536 00000100:00100000:2.0:1789265540.112352:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:2.0:1789265540.112361:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+37:11356:x1876180556897536:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:2.0:1789265540.112622:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+38:11356:x1876180556897536:12345-192.168.202.42@tcp:35:bash.0 Request processed in 261us (821us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789265540.112629:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:0.0:1789265540.298784:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265540.298897:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556897664 00000100:00100000:2.0:1789265540.298908:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556897664 00000100:00100000:2.0:1789265540.298976:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 108 00000100:00100000:2.0:1789265540.298987:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+38:11372:x1876180556897664:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265540.299015:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265540.299039:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91927f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.299118:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d41bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.299131:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d41bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.299144:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d41bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265540.299208:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789265540.299212:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265540.299232:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d41bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.299259:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91927f expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.299277:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d41bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91927f expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.299285:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265540.299288:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265540.299292:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc400, rc 0) 00000100:00100000:2.0:1789265540.299358:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+39:11372:x1876180556897664:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 373us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265540.299365:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 108 00000100:00100000:3.0:1789265540.306663:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265540.306771:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556897920 00000100:00100000:0.0:1789265540.306782:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556897920 00000100:00100000:0.0:1789265540.306847:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 109 00000100:00100000:0.0:1789265540.306888:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+39:11372:x1876180556897920:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1789265540.306912:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265540.306935:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d41c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919286 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.307065:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d41cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.307099:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d41cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.307112:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d41cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265540.307125:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789265540.307237:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d41c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919286 expref: 42 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.307254:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d41cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919286 expref: 41 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.307262:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820c00) 00010000:00010000:0.0:1789265540.307265:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265540.307268:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392c00, rc 0) 00000100:00100000:0.0:1789265540.307350:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+41:11372:x1876180556897920:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 494us (696us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1789265540.307357:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 109 00000100:00100000:3.0:1789265540.311654:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265540.311706:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265540.311803:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556898304 00000100:00100000:0.0:1789265540.311814:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556898304 00000100:00100000:0.0:1789265540.311944:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:0.0:1789265540.311956:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+41:2397:x1876180556898304:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265540.311973:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265540.312000:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d41cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919286 expref: 41 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.312054:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820c00) 00010000:00010000:0.0:1789265540.312060:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265540.312121:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+40:2397:x1876180556898304:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 166us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265540.312129:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:1.0:1789265540.312312:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556898176 00000100:00100000:1.0:1789265540.312317:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556898176 00000100:00100000:1.0:1789265540.312354:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 110 00000100:00100000:1.0:1789265540.312369:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+40:11372:x1876180556898176:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1789265540.312389:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265540.312404:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d41d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91928d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.312513:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d41e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.312529:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d41e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.312540:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d41e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265540.312552:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789265540.312656:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d41d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91928d expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.312670:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d41e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91928d expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265540.312676:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820c00) 00010000:00010000:1.0:1789265540.312679:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789265540.312681:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bda00, rc 0) 00000100:00100000:1.0:1789265540.312708:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+42:11372:x1876180556898176:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 341us (1066us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1789265540.312714:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 110 00000100:00100000:1.0:1789265540.322781:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265540.322898:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556898432 00000100:00100000:0.0:1789265540.322908:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556898432 00000100:00100000:0.0:1789265540.322970:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:0.0:1789265540.322981:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2400:x1876180556898432:12345-192.168.202.42@tcp:1:lfs.0 00010000:00010000:0.0:1789265540.323027:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004614d49e/0xbbfdc9019c1d41ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.323062:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.323072:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265540.323076:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265540.323080:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004614d49e/0xbbfdc9019c1d41ee lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.323120:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.323134:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 8 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265540.323173:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937747f08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1876180579003776:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265540.323267:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff937761554840 going to sleep for 11 seconds 00000100:00100000:0.0:1789265540.326350:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937747f08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1876180579003776:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265540.326382:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004614d49e/0xbbfdc9019c1d41ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265540.328395:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265540.328739:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556898560 00000100:00100000:0.0:1789265540.328749:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556898560 00002000:00100000:0.0:1789265540.328799:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9377507a1880 x1876180556898560/t0(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:111/0 lens 504/0 e 0 to 0 dl 1789265551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265540.328809:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9377507a1880 with x1876180556898560 ext(0->8) 00010000:00010000:0.0:1789265540.328817:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 9 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.328832:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 9 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265540.328840:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9377507a1880 00000100:00100000:0.0:1789265540.328910:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:0.0:1789265540.328920:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2398:x1876180556898560:12345-192.168.202.42@tcp:4:lfs.0 00000100:00100000:0.0:1789265540.330174:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+11:2398:x1876180556898560:12345-192.168.202.42@tcp:4:lfs.0 Request processed in 1247us (1778us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789265540.330185:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 1 00002000:00100000:0.0:1789265540.330210:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9377507a1880 x1876180556898560/t4294967303(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:111/0 lens 504/448 e 0 to 0 dl 1789265551 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265540.330220:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9377507a1880 with x1876180556898560 ext(0->8) 00010000:00010000:0.0:1789265540.330229:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 11 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.330244:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 11 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265540.330251:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9377507a1880 00000100:00100000:3.0:1789265540.333357:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265540.333523:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556898688 00000100:00100000:2.0:1789265540.333535:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556898688 00010000:00010000:2.0:1789265540.333586:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 11 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265540.333631:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:2.0:1789265540.333641:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377583d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+11:2397:x1876180556898688:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265540.333657:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789265540.333677:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789265540.333694:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789265541 00002000:00010000:2.0:1789265540.333696:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789265541 00002000:00010000:2.0:1789265540.333698:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789265541 00002000:00010000:2.0:1789265540.333700:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789265540.333706:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 11 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.333720:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 11 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.333745:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0681451/0xbbfdc9019c1d41af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919278 expref: 11 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.333763:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265540.333767:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265540.333773:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004614d49e/0xbbfdc9019c1d41ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.333783:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004614d49e/0xbbfdc9019c1d41ee lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.333821:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265540.333981:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004614d49e/0xbbfdc9019c1d41ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.333991:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004614d49e/0xbbfdc9019c1d41ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.334016:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004614d49e/0xbbfdc9019c1d41ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.334025:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004614d49e/0xbbfdc9019c1d41ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.334033:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004614d49e/0xbbfdc9019c1d41ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.334055:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265540.334077:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004614d49e/0xbbfdc9019c1d41ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.334088:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004614d49e/0xbbfdc9019c1d41ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.334101:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004614d49e/0xbbfdc9019c1d41ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.334109:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004614d49e/0xbbfdc9019c1d41ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265540.334175:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+10:2400:x1876180556898432:12345-192.168.202.42@tcp:1:lfs.0 Request processed in 11195us (11402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265540.334186:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:2.0:1789265540.334586:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377583d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2397:x1876180556898688:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 945us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265540.334594:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:1.0:1789265540.342599:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265540.342697:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556898944 00000100:00100000:2.0:1789265540.342707:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556898944 00000100:00100000:2.0:1789265540.342769:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:2.0:1789265540.342791:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779d33050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+42:11372:x1876180556898944:12345-192.168.202.42@tcp:35:lfs.0 00000004:00010000:2.0:1789265540.342902:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d41e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91928d expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265540.343226:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1789265540.343263:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789265540.343599:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1789265540.343639:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.343656:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d419a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91926a expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.343665:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.343702:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d419a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91926a expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.343719:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d419a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91926a expref: 46 pid: 6519 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265540.343735:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f586a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876180579003904:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265540.343832:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774831fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265540.347101:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f586a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876180579003904:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265540.347132:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265540.349055:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265540.349327:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556899072 00000100:00100000:0.0:1789265540.349338:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556899072 00010000:00010000:0.0:1789265540.349379:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d419a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91926a expref: 47 pid: 6519 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265540.349423:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:0.0:1789265540.349434:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+47:2399:x1876180556899072:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265540.349452:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265540.349459:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d419a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91926a expref: 47 pid: 6519 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.349472:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d419a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91926a expref: 47 pid: 6519 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.349511:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d419a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91926a expref: 47 pid: 6519 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.349528:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820c00) 00010000:00010000:0.0:1789265540.349533:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.349542:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.349549:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.349592:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265540.349655:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+46:2399:x1876180556899072:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 223us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265540.349663:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 69 00010000:00010000:2.0:1789265540.349838:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.349847:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265540.350009:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1789265540.350153:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1789265540.350242:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f586a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876180579004032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789265540.350299:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265540.350952:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774246d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265540.355441:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579004032 00000100:00100000:3.0:1789265540.355457:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579004032 00000100:00100000:3.0:1789265540.355575:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789265540.355586:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1876180579004032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789265540.355748:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1876180579004032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 164us (5447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265540.355755:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789265540.355838:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f586a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876180579004032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789265540.356048:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1789265540.356128:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f586a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876180579004160:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789265540.356170:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265540.356584:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f151840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265540.356679:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579004160 00000100:00100000:1.0:1789265540.356686:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579004160 00000100:00100000:1.0:1789265540.356719:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789265540.356727:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1876180579004160:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789265540.356925:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6523:x1876180579004160:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 199us (755us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789265540.356933:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789265540.357230:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f586a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876180579004160:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789265540.357306:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1789265540.357343:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.357354:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.357363:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.357368:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265540.357379:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.357388:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.357407:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820c00) 00010000:00010000:2.0:1789265540.357410:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789265540.357415:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.357422:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d41f5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265540.357524:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789265540.357664:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789265540.357676:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396018816320ns, next at 397018814035ns, rc = 0 00000001:00080000:2.0:1789265540.357682:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1789265540.357705:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820c00) 00010000:00010000:2.0:1789265540.357708:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789265540.357714:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d41e0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91928d expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265540.357954:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779d33050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+49:11372:x1876180556898944:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 15164us (15364us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789265540.357961:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 26 00000020:00080000:2.0:1789265540.357966:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789265540.361548:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265540.361649:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556899200 00000100:00100000:2.0:1789265540.361658:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556899200 00000100:00100000:2.0:1789265540.361759:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 111 00000100:00100000:2.0:1789265540.361770:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+49:11372:x1876180556899200:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265540.361809:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265540.361833:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d41fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919294 expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.362066:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d41fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919294 expref: 50 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.362085:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d41fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919294 expref: 50 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.362104:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:2.0:1789265540.362107:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265540.362111:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fda00, rc 0) 00000100:00100000:2.0:1789265540.362165:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+50:11372:x1876180556899200:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 396us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265540.362172:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 111 00000100:00100000:1.0:1789265540.365440:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265540.365523:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556899456 00000100:00100000:3.0:1789265540.365533:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556899456 00000100:00100000:3.0:1789265540.365600:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:3.0:1789265540.365610:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+50:11372:x1876180556899456:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1789265540.365855:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+51:11372:x1876180556899456:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 244us (422us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789265540.365974:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:1.0:1789265540.476663:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265540.476772:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556899584 00000100:00100000:2.0:1789265540.476783:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556899584 00000100:00100000:2.0:1789265540.476843:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 112 00000100:00100000:2.0:1789265540.476853:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+51:11382:x1876180556899584:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:2.0:1789265540.476975:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4203 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.476992:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4203 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477004:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4203 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477049:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d420a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477059:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d420a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477065:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d420a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477154:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4211 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477163:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477169:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265540.477223:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477236:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4203 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477242:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4203 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477249:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4203 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477256:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265540.477260:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4203 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477276:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4203 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477288:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265540.477291:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265540.477296:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4203 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477303:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4203 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477318:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d420a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477324:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d420a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477330:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d420a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477335:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265540.477338:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d420a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477345:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d420a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477352:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820500) 00010000:00010000:2.0:1789265540.477354:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265540.477357:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d420a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477372:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d420a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477383:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477388:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4211 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477394:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4211 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477398:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fdc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265540.477401:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4211 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477406:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4211 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477414:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:2.0:1789265540.477416:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265540.477419:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4211 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.477424:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4211 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265540.477518:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+51:11382:x1876180556899584:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 665us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265540.477526:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 112 00000100:00100000:0.0:1789265540.527554:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265540.527666:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556899840 00000100:00100000:2.0:1789265540.527678:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556899840 00000100:00100000:2.0:1789265540.527739:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 113 00000100:00100000:2.0:1789265540.527750:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+51:11385:x1876180556899840:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265540.527772:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265540.527793:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4218 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91929b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.527902:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d421f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.527917:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d421f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.527929:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d421f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.527942:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4226 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.527949:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.527955:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528100:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d422d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528109:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d422d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528136:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d422d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265540.528147:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789265540.528228:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d421f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528235:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d421f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528242:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d421f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528248:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265540.528253:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d421f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528261:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d421f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528273:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265540.528276:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265540.528281:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d421f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528286:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d421f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528300:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528305:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4226 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528317:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4226 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528321:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265540.528323:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4226 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528329:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4226 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528336:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820500) 00010000:00010000:2.0:1789265540.528339:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265540.528341:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4226 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528347:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4226 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528382:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4218 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91929b expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528395:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d422d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91929b expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.528402:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:2.0:1789265540.528404:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265540.528407:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd800, rc 0) 00000100:00100000:2.0:1789265540.528476:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+53:11385:x1876180556899840:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 728us (930us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789265540.528491:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 113 00000100:00100000:1.0:1789265540.533319:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265540.533399:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556899968 00000100:00100000:2.0:1789265540.533410:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556899968 00000100:00100000:2.0:1789265540.533477:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 114 00000100:00100000:2.0:1789265540.533488:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+53:11385:x1876180556899968:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:2.0:1789265540.533557:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d423b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.533585:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d423b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.533597:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d423b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.533634:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d423b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.533641:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d423b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.533648:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d423b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.533653:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fdc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265540.533658:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d423b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.533666:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d423b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.533677:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:2.0:1789265540.533693:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265540.533699:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d423b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.533706:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d423b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265540.533788:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+53:11385:x1876180556899968:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 301us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265540.533795:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 114 00000100:00100000:1.0:1789265540.538340:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265540.538477:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556900224 00000100:00100000:3.0:1789265540.538488:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556900224 00000100:00100000:3.0:1789265540.538549:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:3.0:1789265540.538560:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+53:11385:x1876180556900224:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1789265540.538806:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+54:11385:x1876180556900224:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 247us (475us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1789265540.538814:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:1.0:1789265540.630376:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265540.630519:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556900480 00000100:00100000:3.0:1789265540.630531:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556900480 00000100:00100000:3.0:1789265540.630603:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 115 00000100:00100000:3.0:1789265540.630614:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+54:11395:x1876180556900480:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1789265540.630638:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265540.630641:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789265540.630668:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d41bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91927f expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.630690:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:3.0:1789265540.630696:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265540.630711:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d4242 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9192a2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.630820:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.630836:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d422d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91929b expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.631166:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.631205:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d422d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91929b expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.631221:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d422d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91929b expref: 54 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265540.631235:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579004288:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265540.631347:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265540.636519:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579004288:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265540.636558:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265540.638050:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265540.638156:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556900608 00000100:00100000:2.0:1789265540.638165:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556900608 00010000:00010000:2.0:1789265540.638204:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d422d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91929b expref: 55 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265540.638246:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:2.0:1789265540.638256:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+55:2399:x1876180556900608:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265540.638271:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265540.638279:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d422d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91929b expref: 55 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.638292:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d422d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91929b expref: 55 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.638314:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d422d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91929b expref: 55 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.638330:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:2.0:1789265540.638335:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.638356:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.638365:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.638397:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265540.638460:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+54:2399:x1876180556900608:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 205us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265540.638468:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 70 00010000:00010000:3.0:1789265540.638538:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.638546:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265540.638565:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789265540.638698:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d4242 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a2 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.638714:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a2 expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.638731:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:3.0:1789265540.638733:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265540.638736:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93774167e400, rc 0) 00000100:00100000:3.0:1789265540.638761:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+54:11395:x1876180556900480:12345-192.168.202.42@tcp:101:bash.0 Request processed in 8151us (8396us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789265540.638768:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 115 00000100:00100000:0.0:1789265540.642584:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265540.642663:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556900736 00000100:00100000:3.0:1789265540.642673:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556900736 00000100:00100000:3.0:1789265540.642731:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 116 00000100:00100000:3.0:1789265540.642741:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+54:11395:x1876180556900736:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1789265540.642767:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265540.642789:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f600/0xbbfdc9019c1d4257 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9192a9 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.642824:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f000/0xbbfdc9019c1d425e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.642851:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f000/0xbbfdc9019c1d425e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.642891:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f000/0xbbfdc9019c1d425e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.643007:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f600/0xbbfdc9019c1d4257 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a9 expref: 56 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.643029:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f000/0xbbfdc9019c1d425e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a9 expref: 55 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.643430:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:3.0:1789265540.643433:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789265540.643436:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93774167f000, rc 0) 00000100:00100000:3.0:1789265540.643505:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+55:11395:x1876180556900736:12345-192.168.202.42@tcp:101:bash.0 Request processed in 765us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265540.643512:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 116 00000100:00100000:0.0:1789265540.647387:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265540.647467:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556900992 00000100:00100000:2.0:1789265540.647478:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556900992 00000100:00100000:2.0:1789265540.647544:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 117 00000100:00100000:2.0:1789265540.647554:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+55:11395:x1876180556900992:12345-192.168.202.42@tcp:36:bash.0 00010000:00010000:2.0:1789265540.647774:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4265 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.647791:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4265 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.647803:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4265 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265540.647843:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1789265540.647906:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007936ad85 reply state 0000000064012fa1 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4265 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.647920:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4265 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.647946:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:2.0:1789265540.647948:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265540.647952:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265540.648050:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+58:11395:x1876180556900992:12345-192.168.202.42@tcp:36:bash.0 Request processed in 488us (662us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789265540.648058:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 117 00000020:00080000:2.0:1789265540.648063:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789265540.651398:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265540.651475:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556901120 00000100:00100000:3.0:1789265540.651485:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556901120 00000100:00100000:3.0:1789265540.651546:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 118 00000100:00100000:3.0:1789265540.651557:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+58:11395:x1876180556901120:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1789265540.651582:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265540.651605:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d426c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9192b0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.651694:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.651709:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a2 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.651718:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.651752:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a2 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.651766:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a2 expref: 59 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265540.651791:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579004416:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265540.651916:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265540.654984:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265540.655116:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556901248 00000100:00100000:0.0:1789265540.655125:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556901248 00010000:00010000:0.0:1789265540.655162:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a2 expref: 60 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265540.655197:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:0.0:1789265540.655207:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+60:2400:x1876180556901248:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265540.655237:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265540.655244:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a2 expref: 60 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.655256:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a2 expref: 60 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.655278:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:0.0:1789265540.655283:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.655293:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.655301:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.655318:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265540.655365:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+60:2400:x1876180556901248:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 160us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265540.655373:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 71 00010000:00010000:3.0:1789265540.655887:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d4249 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a2 expref: 59 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265540.655905:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579004416:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265540.655928:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.655938:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.655943:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265540.655998:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789265540.656002:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265540.656022:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.656072:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d426c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192b0 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.656086:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192b0 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.656094:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:3.0:1789265540.656104:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265540.656108:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219a00, rc 0) 00000100:00100000:3.0:1789265540.656142:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+58:11395:x1876180556901120:12345-192.168.202.42@tcp:101:bash.0 Request processed in 4587us (4754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265540.656150:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 118 00010000:00010000:3.0:1789265540.659237:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265540.661471:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265540.661552:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556901504 00000100:00100000:3.0:1789265540.661572:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556901504 00000100:00100000:3.0:1789265540.661633:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:3.0:1789265540.661643:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+58:11395:x1876180556901504:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:3.0:1789265540.661927:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+59:11395:x1876180556901504:12345-192.168.202.42@tcp:35:bash.0 Request processed in 285us (464us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1789265540.661935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:0.0:1789265540.742673:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265540.742760:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556901632 00000100:00100000:3.0:1789265540.742770:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556901632 00000100:00100000:3.0:1789265540.742837:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 119 00000100:00100000:3.0:1789265540.742847:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+59:11401:x1876180556901632:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265540.742912:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265540.742934:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d427a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9192b7 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.743000:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4281 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.743014:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.743025:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265540.743122:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789265540.743125:0:14174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265540.743146:0:14174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.743172:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d427a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192b7 expref: 61 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.743191:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4281 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192b7 expref: 60 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.743200:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:3.0:1789265540.743203:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265540.743206:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643218a00, rc 0) 00000100:00100000:3.0:1789265540.743476:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+60:11401:x1876180556901632:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 630us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265540.743483:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 119 00000100:00100000:2.0:1789265540.750938:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265540.751027:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556901760 00000100:00100000:0.0:1789265540.751052:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556901760 00000100:00100000:0.0:1789265540.751115:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 120 00000100:00100000:0.0:1789265540.751125:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+60:11401:x1876180556901760:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1789265540.751147:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265540.751167:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4288 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9192be expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751246:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d428f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751261:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d428f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751272:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d428f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751285:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4296 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751292:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751298:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751373:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d429d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751383:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d429d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751390:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d429d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265540.751435:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789265540.751440:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265540.751459:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d429d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751481:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d429d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751490:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d428f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751496:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d428f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751502:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d428f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751507:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392e00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265540.751511:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d428f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751519:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d428f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751531:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:0.0:1789265540.751533:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265540.751537:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d428f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751543:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d428f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751556:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751562:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4296 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751587:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4296 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751592:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265540.751595:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4296 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751601:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4296 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751610:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820500) 00010000:00010000:0.0:1789265540.751613:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265540.751616:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4296 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751622:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4296 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751649:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4288 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192be expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751663:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d429d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192be expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.751671:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:0.0:1789265540.751673:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265540.751675:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392c00, rc 0) 00000100:00100000:0.0:1789265540.751747:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+61:11401:x1876180556901760:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 624us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265540.751764:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 120 00000100:00100000:1.0:1789265540.756705:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265540.756792:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556902016 00000100:00100000:3.0:1789265540.756803:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556902016 00000100:00100000:3.0:1789265540.756907:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 121 00000100:00100000:3.0:1789265540.756918:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+61:11401:x1876180556902016:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265540.756940:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265540.756963:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d42a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9192c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.757100:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.757135:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192b0 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.757143:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d429d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192be expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.757150:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.757187:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d429d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192be expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.757201:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d429d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192be expref: 62 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265540.757216:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579004544:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265540.757341:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192b0 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.757349:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192b0 expref: 62 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265540.757358:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc25f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579004672:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265540.757382:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265540.760388:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265540.760494:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556902144 00000100:00100000:2.0:1789265540.760505:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556902144 00010000:00010000:2.0:1789265540.760544:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d429d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192be expref: 63 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265540.760582:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 72 00000100:00100000:2.0:1789265540.760592:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f467100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+63:2399:x1876180556902144:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265540.760607:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265540.760614:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d429d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192be expref: 63 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.760627:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d429d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192be expref: 63 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.760650:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:2.0:1789265540.760654:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.760664:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.760685:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265540.760747:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f467100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+63:2399:x1876180556902144:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 157us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265540.760755:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 72 00010000:00010000:3.0:1789265540.763548:0:6521:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.42@tcp) returned -22 from blocking AST (req@00000000e7b7c621 x1876180579004544) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d429d lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192be expref: 62 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.763590:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d429d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192be expref: 62 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265540.763608:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579004544:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265540.763625:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc25f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579004672:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265540.763654:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:3.0:1789265540.763659:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.763668:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.763677:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265540.765740:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265540.765943:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556902272 00000100:00100000:0.0:1789265540.765955:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556902272 00010000:00010000:0.0:1789265540.765999:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192b0 expref: 62 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265540.766057:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 73 00000100:00100000:0.0:1789265540.766068:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+62:2400:x1876180556902272:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265540.766087:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265540.766095:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192b0 expref: 62 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.766109:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192b0 expref: 62 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.766133:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4273 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192b0 expref: 62 pid: 6521 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.766150:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:0.0:1789265540.766156:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.766167:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.766175:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265540.766220:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265540.766292:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+61:2400:x1876180556902272:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 225us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265540.766299:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 73 00010000:00010000:3.0:1789265540.766476:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.766485:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265540.766505:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789265540.766647:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d42a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192c5 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.766662:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192c5 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.766681:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:3.0:1789265540.766684:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265540.766686:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93774167e400, rc 0) 00000100:00100000:3.0:1789265540.766714:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+61:11401:x1876180556902016:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 9798us (10019us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1789265540.766721:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 121 00000100:00100000:1.0:1789265540.770755:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265540.771010:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556902528 00000100:00100000:2.0:1789265540.771021:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556902528 00000100:00100000:2.0:1789265540.771101:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:2.0:1789265540.771112:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+61:11401:x1876180556902528:12345-192.168.202.42@tcp:103:lfs.0 00010000:00010000:2.0:1789265540.771127:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265540.771152:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d41fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919294 expref: 61 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.771171:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:2.0:1789265540.771176:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265540.771236:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+60:11401:x1876180556902528:12345-192.168.202.42@tcp:103:lfs.0 Request processed in 126us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265540.771244:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:2.0:1789265540.774722:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265540.774794:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556902656 00000100:00100000:3.0:1789265540.774803:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556902656 00000100:00100000:3.0:1789265540.774904:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 122 00000100:00100000:3.0:1789265540.774915:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+60:11401:x1876180556902656:12345-192.168.202.42@tcp:58:lfs.0 00010000:00010000:3.0:1789265540.775027:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f600/0xbbfdc9019c1d42b9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.775059:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f600/0xbbfdc9019c1d42b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265540.775072:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f600/0xbbfdc9019c1d42b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265540.775172:0:14174:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789265540.775251:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+60:11401:x1876180556902656:12345-192.168.202.42@tcp:58:lfs.0 Request processed in 338us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265540.775259:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 122 00000100:00100000:0.0:1789265540.778725:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265540.778943:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556902784 00000100:00100000:2.0:1789265540.778955:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556902784 00000100:00100000:2.0:1789265540.779020:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 123 00000100:00100000:2.0:1789265540.779031:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+60:11401:x1876180556902784:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265540.779064:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265540.779086:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d42c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9192cc expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.779163:0:9988:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f600/0xbbfdc9019c1d42b9 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.779176:0:9988:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d42c0 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192cc expref: 61 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.779195:0:9988:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f600/0xbbfdc9019c1d42b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.779209:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d42c0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192cc expref: 61 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.779223:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:2.0:1789265540.779226:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265540.779231:0:9988:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d42c0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192cc expref: 61 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265540.779238:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fda00, rc 0) 00000100:00100000:2.0:1789265540.779310:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+61:11401:x1876180556902784:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 280us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265540.779316:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 123 00000040:00080000:0.0:1789265541.107226:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265541.107237:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265541.107274:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789265541.107282:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265541.107425:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1876180579004800:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265541.107546:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff937757b139c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265541.120095:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265541.120262:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1876180579004800:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265541.121049:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556902912 00000100:00100000:3.0:1789265541.121059:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556902912 00000100:00100000:3.0:1789265541.121123:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 124 00000100:00100000:3.0:1789265541.121134:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+61:11402:x1876180556902912:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265541.121183:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265541.121308:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+61:11402:x1876180556902912:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 175us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265541.121316:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 124 00000100:00100000:1.0:1789265541.127328:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265541.127853:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556903040 00000100:00100000:0.0:1789265541.127911:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556903040 00000100:00100000:0.0:1789265541.127989:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 125 00000100:00100000:0.0:1789265541.128000:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+61:11402:x1876180556903040:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789265541.128087:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d42c7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128104:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d42c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128116:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d42c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128132:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d42ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128157:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d42ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128164:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d42ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128188:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d42d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128196:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d42d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128203:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d42d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265541.128251:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789265541.128256:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265541.128270:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d42d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128280:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d42c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128287:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d42c7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128294:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d42c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128300:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392e00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265541.128304:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d42c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128319:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d42c7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128462:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93774712f300) 00010000:00010000:0.0:1789265541.128466:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265541.128471:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d42c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128477:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d42c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128490:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d42ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128496:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d42ce lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128502:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d42ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128507:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265541.128510:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d42ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128515:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d42ce lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128523:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff937779d97600) 00010000:00010000:0.0:1789265541.128525:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265541.128527:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d42ce lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128544:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d42ce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128560:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d42d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128575:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d42d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128581:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d42d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128586:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265541.128589:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d42d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128596:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d42d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128604:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:0.0:1789265541.128607:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265541.128610:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d42d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.128616:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d42d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265541.128706:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+61:11402:x1876180556903040:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 Request processed in 707us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265541.128714:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 125 00000100:00100000:2.0:1789265541.145413:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265541.145545:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556903296 00000100:00100000:0.0:1789265541.145557:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556903296 00000100:00100000:0.0:1789265541.145613:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 126 00000100:00100000:0.0:1789265541.145622:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+61:11402:x1876180556903296:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265541.145641:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265541.145661:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d42dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9192d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.145758:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d42e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.145772:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d42e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.145783:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d42e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265541.145793:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789265541.145942:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d42e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.145950:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d42e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.145956:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d42e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.145962:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265541.145966:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d42e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.145973:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d42e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.145999:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:0.0:1789265541.146002:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789265541.146007:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d42e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.146013:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d42e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.146059:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d42dc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192d3 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.146081:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93774712f300) 00010000:00010000:0.0:1789265541.146084:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265541.146088:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d42dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192d3 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.146098:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392c00, rc 0) 00000100:00100000:0.0:1789265541.146154:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+62:11402:x1876180556903296:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 532us (751us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1789265541.146161:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 126 00000100:00100000:1.0:1789265541.151076:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265541.151221:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556903424 00000100:00100000:0.0:1789265541.151232:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556903424 00000100:00100000:0.0:1789265541.151301:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 127 00000100:00100000:0.0:1789265541.151312:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+62:11402:x1876180556903424:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789265541.151348:0:14174:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789265541.151479:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+62:11402:x1876180556903424:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 169us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265541.151499:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 127 00000100:00100000:1.0:1789265541.157502:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265541.158381:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556903680 00000100:00100000:2.0:1789265541.158393:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556903680 00000100:00100000:2.0:1789265541.158457:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 128 00000100:00100000:2.0:1789265541.158467:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+62:11402:x1876180556903680:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265541.158501:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265541.158504:0:9988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789265541.158534:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4281 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192b7 expref: 62 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.158554:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265541.158558:0:9988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265541.158584:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d42f1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9192da expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265541.159151:0:9988:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789265541.159352:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d42f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.159366:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d42f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.159376:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d42f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.159428:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d42f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192da expref: 64 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.159444:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d42f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192da expref: 63 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.159451:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820c00) 00010000:00010000:2.0:1789265541.159454:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265541.159465:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd600, rc 0) 00000100:00100000:2.0:1789265541.159541:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+63:11402:x1876180556903680:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 1074us (2049us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789265541.159549:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 128 00000100:00100000:3.0:1789265541.173143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265541.173253:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556903936 00000100:00100000:0.0:1789265541.173264:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556903936 00000100:00100000:0.0:1789265541.173339:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 129 00000100:00100000:0.0:1789265541.173350:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+63:11402:x1876180556903936:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789265541.173409:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265541.173436:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d42f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192da expref: 63 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173458:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820c00) 00010000:00010000:0.0:1789265541.173470:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265541.173495:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d4306 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173511:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d4306 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173521:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d4306 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173536:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d430d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x9740917e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173543:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d430d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9740917e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173549:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d430d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9740917e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173623:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d4306 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173630:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d4306 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173637:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d4306 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173644:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265541.173648:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d4306 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173656:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d4306 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173665:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:0.0:1789265541.173667:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265541.173671:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d4306 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173676:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d4306 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173691:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d430d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9740917e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173697:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d430d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9740917e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173704:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d430d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9740917e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173716:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265541.173719:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d430d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9740917e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173725:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d430d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9740917e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173733:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x9740917e (ffff937779d97600) 00010000:00010000:0.0:1789265541.173735:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265541.173737:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d430d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9740917e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.173743:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d430d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9740917e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265541.173838:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+62:11402:x1876180556903936:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 489us (703us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265541.173850:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 129 00000100:00100000:1.0:1789265541.181458:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265541.181564:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556904064 00000100:00100000:2.0:1789265541.181574:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556904064 00000100:00100000:2.0:1789265541.181638:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 130 00000100:00100000:2.0:1789265541.181649:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+62:11402:x1876180556904064:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265541.181670:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265541.181693:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4314 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9192e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.181729:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d431b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.181742:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d431b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.181753:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d431b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.181995:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4314 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e1 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.182013:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d431b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e1 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.182021:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820f00) 00010000:00010000:2.0:1789265541.182024:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265541.182152:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fdc00, rc 0) 00000100:00100000:2.0:1789265541.182271:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+63:11402:x1876180556904064:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 623us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265541.182278:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 130 00000100:00100000:1.0:1789265541.188908:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265541.189381:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556904320 00000100:00100000:3.0:1789265541.189392:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556904320 00000100:00100000:3.0:1789265541.189449:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 131 00000100:00100000:3.0:1789265541.189459:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f46b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+63:11402:x1876180556904320:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265541.189541:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d4322 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.189557:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d4322 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.189569:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d4322 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265541.189728:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1789265541.189737:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396850877485ns, next at 397850874711ns, rc = 0 00000004:00010000:3.0:1789265541.189784:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049741fc6 reply state 00000000a8f27ba3 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d4322 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.189796:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d4322 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.189803:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820f00) 00010000:00010000:3.0:1789265541.189805:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789265541.189816:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265541.189947:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f46b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+65:11402:x1876180556904320:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 489us (1049us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789265541.189955:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 131 00000100:00100000:2.0:1789265541.197770:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265541.197994:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556904448 00000100:00100000:3.0:1789265541.198005:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556904448 00000100:00100000:3.0:1789265541.198087:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 132 00000100:00100000:3.0:1789265541.198098:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+65:11402:x1876180556904448:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265541.198121:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265541.198162:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4329 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9192e8 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.198225:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4329 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e8 expref: 66 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.198239:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4329 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e8 expref: 66 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.198260:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820f00) 00010000:00010000:3.0:1789265541.198263:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265541.198267:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a5600, rc 0) 00000100:00100000:3.0:1789265541.198578:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+66:11402:x1876180556904448:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 480us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265541.198585:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 132 00000100:00100000:1.0:1789265541.203954:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265541.204274:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556904576 00000100:00100000:3.0:1789265541.204286:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556904576 00000100:00100000:2.0:1789265541.204606:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:2.0:1789265541.204617:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2400:x1876180556904576:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789265541.204842:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2400:x1876180556904576:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 226us (897us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789265541.207742:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:2.0:1789265541.209620:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265541.209714:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556904832 00000100:00100000:3.0:1789265541.209725:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556904832 00000100:00100000:3.0:1789265541.209800:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:3.0:1789265541.209809:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+66:11402:x1876180556904832:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789265541.210190:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+67:11402:x1876180556904832:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 381us (578us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789265541.210199:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00080000:1.0:1789265541.212399:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265541.213521:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265541.213626:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556905088 00000100:00100000:2.0:1789265541.213636:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556905088 00000100:00100000:2.0:1789265541.213695:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 133 00000100:00100000:2.0:1789265541.213704:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+67:11402:x1876180556905088:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265541.213838:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+67:11402:x1876180556905088:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 134us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265541.213846:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 133 00000100:00100000:0.0:1789265541.217129:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265541.218848:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556905216 00000100:00100000:2.0:1789265541.218903:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556905216 00000100:00100000:2.0:1789265541.218981:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 134 00000100:00100000:2.0:1789265541.218992:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+67:11402:x1876180556905216:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265541.219013:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265541.219072:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4330 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9192ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.219180:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4337 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.219196:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.219208:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265541.219257:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265541.219276:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.219300:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4330 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192ef expref: 69 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.219319:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192ef expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.219327:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820f00) 00010000:00010000:2.0:1789265541.219342:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789265541.219347:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc400, rc 0) 00000100:00100000:2.0:1789265541.219658:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+68:11402:x1876180556905216:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 667us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265541.219666:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 134 00000100:00100000:1.0:1789265541.224962:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265541.225068:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556905344 00000100:00100000:3.0:1789265541.225080:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556905344 00000100:00100000:3.0:1789265541.225150:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:3.0:1789265541.225162:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2399:x1876180556905344:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265541.225180:0:9789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265541.225201:0:9789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046a8082d/0xbbfdc9019c1d433e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9192f6 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265541.225228:0:9789:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa60686, blocks: 0x0 00010000:00010000:3.0:1789265541.225247:0:9789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1789265541.225252:0:9789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265541.225261:0:9789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046a8082d/0xbbfdc9019c1d433e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192f6 expref: 10 pid: 9789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.225279:0:9789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046a8082d/0xbbfdc9019c1d433e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192f6 expref: 10 pid: 9789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.225294:0:9789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a5e00, rc 0) 00000100:00100000:3.0:1789265541.225361:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+10:2399:x1876180556905344:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 201us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265541.225383:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:2.0:1789265541.234983:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265541.235152:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556905600 00000100:00100000:3.0:1789265541.235163:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556905600 00000100:00100000:3.0:1789265541.235229:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 135 00000100:00100000:3.0:1789265541.235239:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+68:11402:x1876180556905600:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789265541.235365:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+68:11402:x1876180556905600:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 127us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265541.235373:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 135 00000100:00100000:1.0:1789265541.246945:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265541.247092:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556905728 00000100:00100000:0.0:1789265541.247103:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556905728 00000100:00100000:0.0:1789265541.247167:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:0.0:1789265541.247179:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+10:11402:x1876180556905728:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265541.247199:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265541.247221:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3130c92/0xbbfdc9019c1d4345 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9192fd expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.247255:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046a8082d/0xbbfdc9019c1d433e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192f6 expref: 11 pid: 9789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.247277:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265541.247282:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265541.247288:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3130c92/0xbbfdc9019c1d4345 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192fd expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.247477:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046a8082d/0xbbfdc9019c1d433e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192f6 expref: 11 pid: 9789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.247496:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046a8082d/0xbbfdc9019c1d433e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192f6 expref: 11 pid: 9789 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265541.247512:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1876180579004928:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265541.247631:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d7600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265541.254466:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265541.254628:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556905856 00000100:00100000:2.0:1789265541.254639:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556905856 00010000:00010000:2.0:1789265541.254697:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046a8082d/0xbbfdc9019c1d433e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192f6 expref: 12 pid: 9789 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265541.254742:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 74 00000100:00100000:2.0:1789265541.254753:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377583db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+12:2399:x1876180556905856:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265541.254770:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265541.254793:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046a8082d/0xbbfdc9019c1d433e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192f6 expref: 12 pid: 9789 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.254808:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046a8082d/0xbbfdc9019c1d433e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192f6 expref: 12 pid: 9789 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.254837:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265541.254842:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265541.254850:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3130c92/0xbbfdc9019c1d4345 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192fd expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.254909:0:7460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3130c92/0xbbfdc9019c1d4345 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192fd expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.254948:0:7460:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a3130c92/0xbbfdc9019c1d4345 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192fd expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265541.254964:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f476d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7460:1876180579005056:192.168.202.42@tcp:105: 00000100:00100000:2.0:1789265541.255249:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f151c00 going to sleep for 11 seconds 00010000:00010000:0.0:1789265541.255919:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046a8082d/0xbbfdc9019c1d433e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192f6 expref: 12 pid: 9789 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265541.255941:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1876180579004928:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265541.255968:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a3130c92/0xbbfdc9019c1d4345 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192fd expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.255981:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392c00, rc 0) 00000100:00100000:0.0:1789265541.256023:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+11:11402:x1876180556905728:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 8846us (9089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265541.256064:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:3.0:1789265541.264840:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265541.264976:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556905984 00000100:00100000:0.0:1789265541.264988:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556905984 00002000:00100000:0.0:1789265541.265052:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff93775dc24000 x1876180556905984/t0(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:112/0 lens 504/0 e 0 to 0 dl 1789265552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265541.265063:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93775dc24000 with x1876180556905984 ext(0->12) 00002000:00010000:0.0:1789265541.265070:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93775dc24000 00000100:00100000:0.0:1789265541.265102:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:0.0:1789265541.265111:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+11:2399:x1876180556905984:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789265541.267254:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+13:2399:x1876180556905984:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 Request processed in 913us (1194us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789265541.267272:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 2 00002000:00100000:0.0:1789265541.267286:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff93775dc24000 x1876180556905984/t4294967309(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:112/0 lens 504/448 e 0 to 0 dl 1789265552 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265541.267295:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93775dc24000 with x1876180556905984 ext(0->12) 00002000:00010000:0.0:1789265541.267301:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93775dc24000 00000100:00100000:2.0:1789265541.268503:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f476d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7460:1876180579005056:192.168.202.42@tcp:105: 00010000:00010000:2.0:1789265541.268544:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265541.268614:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377583db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+12:2399:x1876180556905856:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 13862us (14160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265541.268624:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 74 00000100:00100000:3.0:1789265541.272537:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265541.272799:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556906112 00000100:00100000:1.0:1789265541.272810:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556906112 00000100:00100000:1.0:1789265541.272923:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 136 00000100:00100000:1.0:1789265541.272934:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+68:11402:x1876180556906112:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789265541.275438:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1789265541.275456:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1789265541.275497:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:1.0:1789265541.275607:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d404a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275621:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d404a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275629:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d404a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275636:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265541.275641:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d404a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275649:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d404a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275667:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff937779d90400) 00010000:00010000:1.0:1789265541.275670:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265541.275675:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d404a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275680:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d404a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275722:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275727:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275733:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275738:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265541.275741:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275747:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275755:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff937777820300) 00010000:00010000:1.0:1789265541.275757:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265541.275760:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40f2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275765:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d40f2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275779:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4170 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275786:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4170 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275791:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4170 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275805:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265541.275808:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4170 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275814:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4170 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275823:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820500) 00010000:00010000:1.0:1789265541.275825:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265541.275828:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4170 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275833:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4170 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275845:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d4193 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275903:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d4193 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275909:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d4193 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275914:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fde00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265541.275916:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d4193 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275922:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d4193 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275940:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff937777820500) 00010000:00010000:1.0:1789265541.275943:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265541.275946:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d4193 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275951:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d4193 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275966:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4265 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275972:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4265 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275978:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4265 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275983:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265541.275987:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4265 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275992:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4265 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.275999:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:1.0:1789265541.276001:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265541.276003:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4265 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.276008:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4265 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.276045:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d4322 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.276051:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d4322 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.276057:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d4322 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.276061:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167e200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265541.276064:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d4322 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.276070:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d4322 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.276078:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820f00) 00010000:00010000:1.0:1789265541.276080:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789265541.276083:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d4322 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.276089:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e200/0xbbfdc9019c1d4322 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265541.278497:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764351b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579005312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789265541.278572:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265541.278615:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265541.278622:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764351a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579005184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789265541.278647:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265541.278683:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579005312 00000100:00100000:3.0:1789265541.278690:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579005312 00000100:00100000:3.0:1789265541.278744:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579005184 00000100:00100000:3.0:1789265541.278747:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579005184 00000100:00100000:3.0:1789265541.278768:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789265541.278777:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1876180579005312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789265541.278949:0:9789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789265541.278953:0:9789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789265542 00002000:00010000:3.0:1789265541.278955:0:9789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789265541.278957:0:9789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789265542 -> 1789265542 00002000:00010000:3.0:1789265541.278960:0:9789:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789265541.279006:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3646:x1876180579005312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 230us (434us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789265541.279013:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789265541.279170:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265541.279178:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1876180579005184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789265541.279192:0:9789:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1789265541.279212:0:9789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045951eed/0xbbfdc9019c1d434c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.279232:0:9789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4100 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919255 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.279241:0:9789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789265541.279245:0:9789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265541.279249:0:9789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045951eed/0xbbfdc9019c1d434c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.279275:0:9789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4100 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919255 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.279289:0:9789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4100 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919255 expref: 11 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265541.279300:0:9789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643519880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9789:1876180579005440:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265541.279362:0:9789:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c09c0 going to sleep for 11 seconds 00000004:00080000:3.0:1789265541.279398:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93764351b800/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789265541.279410:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764351b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579005312:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1789265541.279517:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265541.282628:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265541.282651:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579005568:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789265541.282726:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265541.282821:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579005568 00000100:00100000:2.0:1789265541.282829:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579005568 00000100:00100000:2.0:1789265541.282908:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789265541.282918:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3644:x1876180579005568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789265541.282945:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:2.0:1789265541.282979:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa60685, atime: 0x6aa60685, ctime: 0x6aa60685, blocks: 0x8 00010000:00010000:2.0:1789265541.282987:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4353 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.283003:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1789265541.283007:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265541.283013:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.283047:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.283058:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.283066:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.283105:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789265541.283251:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3644:x1876180579005568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 334us (524us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789265541.283259:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1789265541.283281:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265541.283288:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.283296:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:2.0:1789265541.283301:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.283310:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4353 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.283327:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4353 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.283334:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4353 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.283356:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265541.283358:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265541.283360:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789265541.283574:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93777f476d80/2, rc 0, transno 4294967305 00000100:00100000:1.0:1789265541.283581:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579005568:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1789265541.285697:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93774557fd80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789265541.285709:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff937742cd2100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff937747dd1600 00000020:00080000:0.0:1789265541.285712:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff937742cd2500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff937643225c00 00000004:00080000:0.0:1789265541.285755:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789265541.285819:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff937748102180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789265541.285823:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9376425ca500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff937748102480 00000020:00080000:0.0:1789265541.285825:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9376425ca900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93764362f600 00000100:00100000:1.0:1789265541.286235:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+16:11402:x1876180556906112:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 Request processed in 13296us (13700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265541.286245:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 136 00000020:00080000:3.0:1789265541.287196:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789265541.287266:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789265541.290529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265541.290636:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556906240 00000100:00100000:2.0:1789265541.290644:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556906240 00000100:00100000:0.0:1789265541.290650:0:9789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643519880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9789:1876180579005440:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265541.290679:0:9789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000045951eed/0xbbfdc9019c1d434c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.290692:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4100 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919255 expref: 12 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265541.290734:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 75 00000100:00100000:2.0:1789265541.290744:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+12:2399:x1876180556906240:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265541.290758:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265541.290764:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4100 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919255 expref: 12 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.290777:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4100 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919255 expref: 12 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.290801:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4100 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919255 expref: 12 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.290817:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265541.290821:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789265541.290826:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045951eed/0xbbfdc9019c1d434c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.290836:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045951eed/0xbbfdc9019c1d434c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.290899:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265541.290915:0:9789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000045951eed/0xbbfdc9019c1d434c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.290923:0:9789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045951eed/0xbbfdc9019c1d434c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.290933:0:9789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045951eed/0xbbfdc9019c1d434c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.290940:0:9789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045951eed/0xbbfdc9019c1d434c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265541.290948:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+11:2399:x1876180556906240:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 206us (430us total) trans 0 rc 0/0 00010000:00010000:0.0:1789265541.290955:0:9789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789265541.290965:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 75 00010000:00010000:1.0:1789265541.291049:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265541.291056:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045951eed/0xbbfdc9019c1d434c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.291073:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4800 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265541.291077:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045951eed/0xbbfdc9019c1d434c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.291086:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045951eed/0xbbfdc9019c1d434c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.291098:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045951eed/0xbbfdc9019c1d434c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.291105:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045951eed/0xbbfdc9019c1d434c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.291122:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265541.291124:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265541.291125:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265541.291148:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3646:x1876180579005184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11970us (12498us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789265541.291157:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:2.0:1789265541.291184:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93764351a680/2, rc 0, transno 4294967311 00000100:00100000:2.0:1789265541.291190:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764351a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579005184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789265541.301113:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265541.301221:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556906368 00000100:00100000:2.0:1789265541.301231:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556906368 00000100:00100000:2.0:1789265541.301289:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:2.0:1789265541.301299:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+11:2400:x1876180556906368:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789265541.304347:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1789265541.304367:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1789265541.308292:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556906368:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 Request processed in 6983us (7177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265541.308306:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:3.0:1789265541.312068:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265541.312464:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556906624 00000100:00100000:1.0:1789265541.312475:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556906624 00000100:00100000:1.0:1789265541.312601:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 137 00000100:00100000:1.0:1789265541.312612:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+16:11402:x1876180556906624:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789265541.312671:0:9988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265541.312700:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4337 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192ef expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.312720:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820f00) 00010000:00010000:1.0:1789265541.312725:0:9988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265541.312758:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d435a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.312772:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d435a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.312782:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d435a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265541.312957:0:9988:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb87428d reply state 0000000031eea422 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d435a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.312971:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d435a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.312977:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820f00) 00010000:00010000:1.0:1789265541.312980:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265541.312982:0:9988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265541.313109:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+17:11402:x1876180556906624:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 496us (1048us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1789265541.313116:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 137 00000100:00100000:3.0:1789265541.316766:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265541.317467:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556906752 00000100:00100000:1.0:1789265541.317495:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556906752 00000100:00100000:1.0:1789265541.317551:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:1.0:1789265541.317561:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556906752:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789265541.317743:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789265541.317747:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789265542 -> 1789265541 00002000:00010000:1.0:1789265541.317749:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789265541 00002000:00010000:1.0:1789265541.317751:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789265542 -> 1789265541 00002000:00010000:1.0:1789265541.317753:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789265541.317832:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2400:x1876180556906752:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 272us (1265us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789265541.317840:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:2.0:1789265541.330074:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265541.330183:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556907008 00000100:00100000:0.0:1789265541.330193:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556907008 00000100:00100000:0.0:1789265541.330255:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 138 00000100:00100000:0.0:1789265541.330282:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+17:11402:x1876180556907008:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789265541.330364:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.330381:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d431b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e1 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.330390:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.330425:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d431b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e1 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.330439:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d431b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e1 expref: 17 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265541.330455:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876180579005696:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265541.330545:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265541.333527:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876180579005696:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265541.333559:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265541.351173:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265541.351671:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556907136 00000100:00100000:1.0:1789265541.351681:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556907136 00010000:00010000:1.0:1789265541.351721:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d431b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e1 expref: 18 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265541.351768:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 76 00000100:00100000:1.0:1789265541.351780:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+18:2400:x1876180556907136:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265541.351795:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265541.351800:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d431b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e1 expref: 18 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.351814:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d431b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e1 expref: 18 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.351840:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d431b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e1 expref: 18 pid: 6520 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.352225:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820f00) 00010000:00010000:1.0:1789265541.352231:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.352241:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.352248:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.352446:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265541.352518:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+17:2400:x1876180556907136:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 739us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265541.352526:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 76 00010000:00010000:0.0:1789265541.355218:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.355236:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.355286:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.355311:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.355320:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.355325:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392e00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265541.355462:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.355472:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.355491:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820f00) 00010000:00010000:0.0:1789265541.355494:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789265541.355499:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.355505:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4361 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265541.355831:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+16:11402:x1876180556907008:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 Request processed in 25546us (25761us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789265541.355841:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 138 00000100:00100000:2.0:1789265541.365310:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265541.365494:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556907264 00000100:00100000:3.0:1789265541.365504:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556907264 00000100:00100000:3.0:1789265541.365563:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:3.0:1789265541.365573:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2398:x1876180556907264:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789265541.365617:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000077ff51d0/0xbbfdc9019c1d4368 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.365638:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3130c92/0xbbfdc9019c1d4345 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192fd expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.365646:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789265541.365651:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265541.365655:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077ff51d0/0xbbfdc9019c1d4368 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.365699:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3130c92/0xbbfdc9019c1d4345 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192fd expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.365713:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3130c92/0xbbfdc9019c1d4345 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192fd expref: 7 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265541.365752:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643519500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1876180579005824:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265541.365849:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265541.368818:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643519500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1876180579005824:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265541.368851:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000077ff51d0/0xbbfdc9019c1d4368 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265541.369052:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265541.369141:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556907392 00000100:00100000:1.0:1789265541.369149:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556907392 00010000:00010000:1.0:1789265541.369188:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3130c92/0xbbfdc9019c1d4345 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192fd expref: 8 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265541.369229:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 77 00000100:00100000:1.0:1789265541.369239:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f467100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2399:x1876180556907392:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265541.369253:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265541.369274:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3130c92/0xbbfdc9019c1d4345 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192fd expref: 8 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.369286:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3130c92/0xbbfdc9019c1d4345 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192fd expref: 8 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.369343:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3130c92/0xbbfdc9019c1d4345 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192fd expref: 8 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.369360:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265541.369364:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265541.369370:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077ff51d0/0xbbfdc9019c1d4368 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.369380:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077ff51d0/0xbbfdc9019c1d4368 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.369410:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265541.369470:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f467100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556907392:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 232us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265541.369478:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 77 00010000:00010000:3.0:1789265541.369918:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000077ff51d0/0xbbfdc9019c1d4368 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.369929:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077ff51d0/0xbbfdc9019c1d4368 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.369952:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000077ff51d0/0xbbfdc9019c1d4368 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.369961:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077ff51d0/0xbbfdc9019c1d4368 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.369969:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077ff51d0/0xbbfdc9019c1d4368 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.369976:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265541.369981:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077ff51d0/0xbbfdc9019c1d4368 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.370007:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077ff51d0/0xbbfdc9019c1d4368 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.370021:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077ff51d0/0xbbfdc9019c1d4368 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.370045:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077ff51d0/0xbbfdc9019c1d4368 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265541.370110:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2398:x1876180556907264:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 Request processed in 4537us (4809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265541.370118:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:2.0:1789265541.378167:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265541.378275:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556907648 00000100:00100000:1.0:1789265541.378287:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556907648 00000100:00100000:1.0:1789265541.378357:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 139 00000100:00100000:1.0:1789265541.378367:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+16:11402:x1876180556907648:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789265541.378447:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.378465:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f000/0xbbfdc9019c1d425e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a9 expref: 16 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.378475:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.378525:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f000/0xbbfdc9019c1d425e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a9 expref: 16 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.378537:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f000/0xbbfdc9019c1d425e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a9 expref: 16 pid: 14174 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265541.378553:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579005952:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265541.378642:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff937643557780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265541.383249:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579005952:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265541.383281:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265541.383959:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265541.384290:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556907776 00000100:00100000:0.0:1789265541.384300:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556907776 00010000:00010000:0.0:1789265541.384348:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f000/0xbbfdc9019c1d425e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a9 expref: 17 pid: 14174 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265541.384392:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 78 00000100:00100000:0.0:1789265541.384419:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+17:2400:x1876180556907776:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265541.384435:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265541.384443:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f000/0xbbfdc9019c1d425e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a9 expref: 17 pid: 14174 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.384456:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f000/0xbbfdc9019c1d425e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a9 expref: 17 pid: 14174 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.384479:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f000/0xbbfdc9019c1d425e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192a9 expref: 17 pid: 14174 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.384495:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:0.0:1789265541.384501:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d42c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192cc expref: 16 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.384511:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.384518:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.384525:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.384555:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265541.384615:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+16:2400:x1876180556907776:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 198us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265541.384623:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 78 00010000:00010000:2.0:1789265541.384985:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.384994:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.385185:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.385198:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4329 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e8 expref: 16 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.385206:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.385237:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4329 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e8 expref: 16 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.385251:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4329 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e8 expref: 16 pid: 14174 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265541.385265:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579006080:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265541.385351:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745562e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265541.393992:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265541.394275:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556907904 00000100:00100000:3.0:1789265541.394285:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556907904 00010000:00010000:3.0:1789265541.394324:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4329 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e8 expref: 17 pid: 14174 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265541.394376:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 79 00000100:00100000:3.0:1789265541.394386:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+17:2399:x1876180556907904:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265541.394399:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265541.394406:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4329 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e8 expref: 17 pid: 14174 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.394420:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4329 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e8 expref: 17 pid: 14174 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.394464:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820f00) 00010000:00010000:3.0:1789265541.394469:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.394478:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.394486:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265541.394506:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265541.394565:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+17:2399:x1876180556907904:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 180us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265541.394580:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 79 00010000:00010000:1.0:1789265541.394982:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4329 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192e8 expref: 16 pid: 14174 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265541.394999:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579006080:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265541.395020:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.395027:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.395043:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265541.395169:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1789265541.395288:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1789265541.395343:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1789265541.395429:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876180579006208:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789265541.395484:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265541.395526:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff937643557780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265541.395607:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579006208 00000100:00100000:2.0:1789265541.395613:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579006208 00000100:00100000:2.0:1789265541.395650:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789265541.395658:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1876180579006208:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789265541.395734:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1876180579006208:12345-0@lo:1000:mdt00_002.0 Request processed in 76us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265541.395741:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789265541.396062:0:6521:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789265541.396067:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:1.0:1789265541.396085:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93764351b800, transno 4294967310 00000004:00080000:1.0:1789265541.396104:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93764351a680, transno 4294967311 00000100:00100000:1.0:1789265541.396111:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876180579006208:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789265541.396225:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1789265541.396269:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876180579006336:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789265541.396306:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265541.396323:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff937643557a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265541.396627:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579006336 00000100:00100000:0.0:1789265541.396641:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579006336 00000100:00100000:0.0:1789265541.396675:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789265541.396683:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1876180579006336:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789265541.396783:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1876180579006336:12345-0@lo:1000:mdt00_002.0 Request processed in 101us (475us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789265541.396790:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789265541.398883:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876180579006336:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789265541.398949:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.398960:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.398967:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.398973:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fdc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265541.398977:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.398985:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.399002:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820f00) 00010000:00010000:1.0:1789265541.399005:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265541.399010:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.399048:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4376 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.399079:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f600/0xbbfdc9019c1d42b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.399086:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f600/0xbbfdc9019c1d42b9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.399093:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f600/0xbbfdc9019c1d42b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.399098:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167f600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265541.399101:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f600/0xbbfdc9019c1d42b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.399107:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f600/0xbbfdc9019c1d42b9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.399115:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:1.0:1789265541.399117:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265541.399123:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d42c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192cc expref: 19 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.399134:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d42c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192cc expref: 19 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.399144:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d42c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192cc expref: 19 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.399193:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d42c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192cc expref: 19 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265541.399207:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579006464:192.168.202.42@tcp:105: 00000100:00100000:1.0:1789265541.402192:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff937643557a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265541.403049:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579006464:192.168.202.42@tcp:105: 00010000:00010000:1.0:1789265541.403081:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f600/0xbbfdc9019c1d42b9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403092:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167f600/0xbbfdc9019c1d42b9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403132:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d437d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403146:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d437d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403157:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d437d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403168:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d437d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403174:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d437d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403181:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d437d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403205:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265541.403209:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d437d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403216:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d437d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403228:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:1.0:1789265541.403231:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265541.403234:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d437d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403240:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d437d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403250:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403256:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403262:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403267:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265541.403269:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403274:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403293:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:1.0:1789265541.403295:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265541.403298:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.403303:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d436f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265541.403493:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+19:11402:x1876180556907648:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 25126us (25335us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789265541.403504:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 139 00000020:00080000:1.0:1789265541.403509:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789265541.405088:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265541.405095:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265541.405661:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789265541.405671:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265541.409523:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265541.409719:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556908032 00000100:00100000:1.0:1789265541.409730:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556908032 00000100:00100000:1.0:1789265541.409801:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:1.0:1789265541.409811:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+19:11401:x1876180556908032:12345-192.168.202.42@tcp:49:lfs.0 00000100:00100000:1.0:1789265541.409968:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+19:11401:x1876180556908032:12345-192.168.202.42@tcp:49:lfs.0 Request processed in 158us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265541.409975:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:3.0:1789265541.415532:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265541.416792:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556908288 00000100:00100000:1.0:1789265541.416811:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556908288 00000100:00100000:1.0:1789265541.416911:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00100000:1.0:1789265541.416922:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779d31850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+19:11402:x1876180556908288:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789265541.417228:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789265541.417264:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1789265541.417299:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4384 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.417330:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4384 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.417342:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4384 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.417350:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4384 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.417357:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4384 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.417362:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4384 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265541.417382:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789265541.417491:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779d31850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+21:11402:x1876180556908288:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 571us (1968us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789265541.417500:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 32 00000020:00080000:1.0:1789265541.417505:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789265541.417931:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265541.417939:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4384 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.417947:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc200 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265541.417950:0:13735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4384 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.417959:0:13735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4384 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.417972:0:13735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820f00) 00010000:00010000:0.0:1789265541.417975:0:13735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789265541.417980:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4384 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.417986:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d4384 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.417999:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265541.418000:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265541.418002:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265541.425595:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265541.425667:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556908544 00000100:00100000:1.0:1789265541.425677:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556908544 00000100:00100000:1.0:1789265541.425745:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 140 00000100:00100000:1.0:1789265541.425755:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+21:11401:x1876180556908544:12345-192.168.202.42@tcp:58:lfs.0 00000040:00080000:1.0:1789265541.425978:0:9988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789265541.426093:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+21:11401:x1876180556908544:12345-192.168.202.42@tcp:58:lfs.0 Request processed in 339us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265541.426101:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 140 00000100:00100000:2.0:1789265541.474200:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265541.474745:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556908672 00000100:00100000:0.0:1789265541.474756:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556908672 00000100:00100000:0.0:1789265541.474825:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 141 00000100:00100000:0.0:1789265541.474850:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+21:11404:x1876180556908672:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1789265541.474922:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265541.474944:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d438b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919304 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.475008:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4392 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.475023:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4392 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.475044:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4392 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.475060:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4399 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.475067:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.475073:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.475149:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d43a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.475161:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192c5 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.475169:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d43a0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.475214:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192c5 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.475228:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192c5 expref: 22 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265541.475243:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876180579006592:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265541.475338:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265541.479068:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265541.479160:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556908928 00000100:00100000:1.0:1789265541.479176:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556908928 00000100:00100000:1.0:1789265541.479237:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:1.0:1789265541.479247:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+23:6170:x1876180556908928:12345-192.168.202.42@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789265541.479489:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+24:6170:x1876180556908928:12345-192.168.202.42@tcp:35:ldlm_bl.0 Request processed in 244us (433us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789265541.479496:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:2.0:1789265541.479774:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876180579006592:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265541.479800:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d43a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265541.484343:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265541.484703:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556909056 00000100:00100000:0.0:1789265541.484715:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556909056 00010000:00010000:0.0:1789265541.484756:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192c5 expref: 24 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265541.484902:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 80 00000100:00100000:0.0:1789265541.484914:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+24:2400:x1876180556909056:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265541.484930:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265541.484938:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192c5 expref: 24 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.484952:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192c5 expref: 24 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.484975:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167e400/0xbbfdc9019c1d42ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192c5 expref: 24 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.485008:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:0.0:1789265541.485014:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d43a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.485045:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d43a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.485054:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d43a0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265541.485087:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265541.485157:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+23:2400:x1876180556909056:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 244us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265541.485166:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 80 00010000:00010000:2.0:1789265541.485172:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d43a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485183:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d43a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265541.485478:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789265541.485484:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265541.485505:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d43a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485519:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d43a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485529:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4392 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485535:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4392 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485541:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4392 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485557:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265541.485562:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4392 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485571:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4392 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485581:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:2.0:1789265541.485584:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265541.485588:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4392 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485593:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4392 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485605:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485610:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4399 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485615:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485620:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265541.485623:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485628:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4399 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485658:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93774712f700) 00010000:00010000:2.0:1789265541.485660:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265541.485663:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4399 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485670:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4399 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485708:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d438b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919304 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485722:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d43a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919304 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265541.485729:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:2.0:1789265541.485731:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265541.485733:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392c00, rc 0) 00000100:00100000:2.0:1789265541.485782:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+22:11404:x1876180556908672:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 10935us (11594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265541.485791:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 141 00010000:00010000:3.0:1789265541.683709:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789265542.141711:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1789265542.141730:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000040:00080000:1.0:1789265542.240255:0:14263:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265542.240263:0:14263:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265542.240284:0:14263:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789265542.240290:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789265542.451158:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265542.451168:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265542.451223:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789265542.451236:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265542.451381:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1876180579006720:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265542.451483:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff937747dd4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265542.457347:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265542.457507:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556909184 00000100:00100000:1.0:1789265542.457517:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556909184 00000100:00100000:1.0:1789265542.457592:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 142 00000100:00100000:1.0:1789265542.457602:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+23:11417:x1876180556909184:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000100:00080000:0.0:1789265542.457734:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:1.0:1789265542.458010:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789265542.458174:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+23:11417:x1876180556909184:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 571us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265542.458183:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 142 00000100:00100000:2.0:1789265542.458312:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1876180579006720:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265542.467240:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265542.467332:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556909440 00000100:00100000:1.0:1789265542.467343:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556909440 00000100:00100000:1.0:1789265542.467408:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 143 00000100:00100000:1.0:1789265542.467419:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+22:11417:x1876180556909440:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265542.467439:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265542.467460:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d43a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91930b expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265542.467579:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d43ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265542.467607:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d43ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265542.467623:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d43ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265542.467648:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789265542.467750:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d43a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91930b expref: 25 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265542.467768:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d43ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91930b expref: 24 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265542.467776:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:1.0:1789265542.467779:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265542.467783:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd600, rc 0) 00000100:00100000:1.0:1789265542.467843:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+24:11417:x1876180556909440:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 427us (987us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789265542.467851:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 143 00000100:00100000:0.0:1789265542.474248:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265542.474294:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265542.474433:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556909568 00000100:00100000:3.0:1789265542.474445:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556909568 00000100:00100000:3.0:1789265542.474531:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:3.0:1789265542.474543:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377583d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+24:2400:x1876180556909568:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265542.474560:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265542.474604:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d43ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91930b expref: 24 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265542.474629:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:3.0:1789265542.474651:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265542.474721:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377583d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+23:2400:x1876180556909568:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 180us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265542.474728:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:2.0:1789265542.479389:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556909824 00000100:00100000:2.0:1789265542.479411:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556909824 00000100:00100000:2.0:1789265542.480323:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 144 00000100:00100000:2.0:1789265542.480338:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+23:11417:x1876180556909824:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789265542.480420:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d43bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265542.480451:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d43bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265542.480464:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d43bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265542.480624:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d43bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265542.480633:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d43bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265542.480655:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d43bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265542.480661:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265542.480666:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d43bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265542.480674:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d43bc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265542.480687:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:2.0:1789265542.480690:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265542.480709:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d43bc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265542.480717:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d43bc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265542.480905:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+24:11417:x1876180556909824:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 569us (6608us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789265542.480914:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 144 00000040:00080000:0.0:1789265542.484030:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265542.484039:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265542.484525:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789265542.484538:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265542.493578:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265542.493753:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556910080 00000100:00100000:3.0:1789265542.493764:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556910080 00000100:00100000:3.0:1789265542.493830:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:3.0:1789265542.493841:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+24:11417:x1876180556910080:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789265542.494145:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+25:11417:x1876180556910080:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 305us (576us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789265542.494154:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 34 00010000:00010000:1.0:1789265542.708338:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265543.155331:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579006976:0@lo:400:kworker.0 00000100:00100000:0.0:1789265543.155408:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265543.155438:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180579006848:0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.155454:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180579007232:0@lo:400:kworker.0 00000100:00100000:2.0:1789265543.155485:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265543.155493:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180579007488:0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.155501:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265543.155525:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579007360:0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.155535:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579007744:0@lo:400:kworker.0 00000100:00100000:0.0:1789265543.155542:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265543.155568:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265543.155576:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265543.155582:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180579008000:0@lo:400:kworker.0 00000100:00100000:2.0:1789265543.155599:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579007872:0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.155604:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579008256:0@lo:400:kworker.0 00000100:00100000:0.0:1789265543.155615:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265543.155637:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265543.155643:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789265543.155653:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579006848 00000100:00100000:0.0:1789265543.155653:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579007104:0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.155661:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579006848 00000100:00100000:2.0:1789265543.155667:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579008384:0@lo:400:kworker.0 00000100:00100000:0.0:1789265543.155688:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265543.155701:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265543.155713:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180579007616:0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.155720:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789265543.155731:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180579006848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265543.155746:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265543.155747:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579007360 00000100:00100000:2.0:1789265543.155753:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579007360 00000100:00100000:0.0:1789265543.155769:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180579008128:0@lo:400:kworker.0 00000100:00100000:2.0:1789265543.155783:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579007104 00000100:00100000:2.0:1789265543.155787:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579007104 00000100:00100000:0.0:1789265543.155801:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265543.155812:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180579006848:12345-0@lo:400:kworker.0 Request processed in 82us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265543.155822:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789265543.155826:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789265543.155833:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579007744 00000100:00100000:2.0:1789265543.155838:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579007360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265543.155840:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579007744 00000100:00100000:3.0:1789265543.155902:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579006976 00000100:00100000:3.0:1789265543.155907:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579006976 00000100:00100000:3.0:1789265543.155938:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579007232 00000100:00100000:3.0:1789265543.155942:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579007232 00000100:00100000:3.0:1789265543.155957:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579007488 00000100:00100000:3.0:1789265543.155959:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579007488 00000100:00100000:1.0:1789265543.155963:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579007872 00000100:00100000:1.0:1789265543.155969:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579007872 00000100:00100000:3.0:1789265543.155975:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579008000 00000100:00100000:3.0:1789265543.155980:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579008000 00000100:00100000:3.0:1789265543.155999:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579007616 00000100:00100000:3.0:1789265543.156002:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579007616 00000100:00100000:1.0:1789265543.156006:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579008384 00000100:00100000:1.0:1789265543.156011:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579008384 00000100:00100000:3.0:1789265543.156028:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579008128 00000100:00100000:3.0:1789265543.156033:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579008128 00000100:00100000:1.0:1789265543.156045:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789265543.156056:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579007872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.156058:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789265543.156070:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579006976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265543.156105:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579007872:12345-0@lo:400:kworker.0 Request processed in 52us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265543.156121:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579006976:12345-0@lo:400:kworker.0 Request processed in 52us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265543.156123:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789265543.156134:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789265543.160156:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789265543.160189:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180579007232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.160289:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180579007232:12345-0@lo:400:kworker.0 Request processed in 116us (4789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265543.160298:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789265543.160336:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789265543.160345:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180579007488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265543.160375:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789265543.160382:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180579007488:12345-0@lo:400:kworker.0 Request processed in 38us (4840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265543.160390:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789265543.160394:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180579008384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.160410:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789265543.160419:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180579008000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265543.160458:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180579008384:12345-0@lo:400:kworker.0 Request processed in 73us (4758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265543.160465:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180579008000:12345-0@lo:400:kworker.0 Request processed in 45us (4848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265543.160485:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789265543.160498:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789265543.160505:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180579007616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.160540:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180579007616:12345-0@lo:400:kworker.0 Request processed in 37us (4797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265543.160545:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789265543.160564:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789265543.160572:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180579008128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265543.160585:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789265543.160598:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579007744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.160605:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180579008128:12345-0@lo:400:kworker.0 Request processed in 32us (4802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265543.160612:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789265543.160644:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579007744:12345-0@lo:400:kworker.0 Request processed in 50us (5069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265543.160651:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789265543.160654:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789265543.160665:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579007104:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789265543.160690:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265543.160696:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265543.160700:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265543.160704:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265543.160708:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579007104:12345-0@lo:400:kworker.0 Request processed in 46us (5019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265543.160716:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789265543.160746:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579007104:0@lo:400:kworker.0 00010000:00080000:0.0:1789265543.160766:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f422300 x1876180579007616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265543.160777:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180579007616:0@lo:400:kworker.0 00000100:00100000:1.0:1789265543.160809:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789265543.160926:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789265543.160948:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643df3480 x1876180579008128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265543.160969:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180579008128:0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.160984:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180579007232:0@lo:400:kworker.0 00000100:00100000:0.0:1789265543.160988:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180579008000:0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.161005:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579007744:0@lo:400:kworker.0 00000100:00100000:0.0:1789265543.161009:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579006976:0@lo:400:kworker.0 00000100:00100000:0.0:1789265543.161034:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180579007488:0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.161076:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180579006848:0@lo:400:kworker.0 00000100:00100000:0.0:1789265543.161082:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579008256 00000100:00100000:0.0:1789265543.161089:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579008256 00000100:00100000:3.0:1789265543.161091:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1789265543.161097:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:3.0:1789265543.161117:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93777f585500, transno 4294967302 00000100:00100000:0.0:1789265543.161136:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000004:00080000:3.0:1789265543.161140:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1789265543.161153:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93777f476d80, transno 4294967305 00000100:00100000:3.0:1789265543.161158:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579007872:0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.161174:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579008384:0@lo:400:kworker.0 00000100:00100000:2.0:1789265543.161243:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579007360:12345-0@lo:400:kworker.0 Request processed in 5407us (5674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265543.161252:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789265543.161304:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579007360:0@lo:400:kworker.0 00000100:00100000:0.0:1789265543.161359:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579008256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265543.161410:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579008256:12345-0@lo:400:kworker.0 Request processed in 267us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265543.161417:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1789265543.161446:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265543.164239:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579008256:0@lo:400:kworker.0 00000100:00100000:3.0:1789265543.667409:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265543.667437:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579008512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265543.667512:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265543.667647:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579008512 00000100:00100000:1.0:1789265543.667656:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579008512 00000100:00100000:1.0:1789265543.667716:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789265543.667727:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579008512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265543.667759:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789265543.667804:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579008512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265543.667811:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789265543.667925:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579008512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265543.669178:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265543.669202:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579008640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265543.669280:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265543.669923:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579008640 00000100:00100000:1.0:1789265543.669931:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579008640 00000100:00100000:1.0:1789265543.669981:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789265543.669990:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876180579008640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265543.670029:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789265543.670087:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876180579008640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265543.670094:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789265543.670153:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579008640:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265543.733615:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265543.933341:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265543.933400:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556910208 00000100:00100000:0.0:1789265543.933412:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556910208 00000100:00100000:0.0:1789265543.933481:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 388 00000100:00100000:0.0:1789265543.933492:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:2399:x1876180556910208:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265543.933762:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:2399:x1876180556910208:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 270us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265543.933771:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 388 00000100:00100000:3.0:1789265543.936938:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265543.937063:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556910336 00000100:00100000:3.0:1789265543.937072:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556910336 00000100:00100000:3.0:1789265543.937446:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 306 00000100:00100000:3.0:1789265543.937457:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+25:2399:x1876180556910336:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265543.937549:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+25:2399:x1876180556910336:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 93us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265543.937556:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 306 00000100:00100000:3.0:1789265543.942299:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265543.942339:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265543.942366:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265543.942391:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265543.942426:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265543.942455:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556910592 00000100:00100000:3.0:1789265543.942466:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556910592 00000100:00100000:1.0:1789265543.942616:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556910720 00000100:00100000:1.0:1789265543.942622:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556910720 00000100:00100000:1.0:1789265543.942680:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 148 00000100:00100000:1.0:1789265543.942690:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556910720:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265543.942781:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556910720:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 92us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265543.942790:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 148 00000100:00100000:0.0:1789265543.943655:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556910848 00000100:00100000:0.0:1789265543.943662:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556910848 00000100:00100000:0.0:1789265543.943727:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556910464 00000100:00100000:0.0:1789265543.943731:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556910464 00000100:00100000:0.0:1789265543.943764:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556910976 00000100:00100000:0.0:1789265543.943768:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556910976 00000100:00100000:3.0:1789265543.943769:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 149 00000100:00100000:3.0:1789265543.943783:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556910592:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265543.943791:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 307 00000100:00100000:0.0:1789265543.943802:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556910848:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265543.943844:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556910592:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 64us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265543.943851:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556910848:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 48us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265543.943881:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 307 00000100:00100000:3.0:1789265543.943888:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 149 00000100:00100000:0.0:1789265543.943899:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 308 00000100:00100000:0.0:1789265543.943907:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556910464:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265543.943930:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556910464:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 25us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265543.943936:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 308 00000100:00100000:0.0:1789265543.943949:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 309 00000100:00100000:0.0:1789265543.943956:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556910976:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265543.943978:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556910976:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265543.943984:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 309 00000100:00080000:3.0:1789265543.944628:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265543.944632:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265543.944635:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265543.944637:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789265544.316995:0:14315:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265544.317035:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265544.317081:0:14315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789265544.317090:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265544.576226:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265544.576327:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556911232 00000100:00100000:1.0:1789265544.576338:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556911232 00000100:00080000:3.0:1789265544.576441:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265544.576617:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 145 00000100:00100000:1.0:1789265544.576629:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+25:11438:x1876180556911232:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1789265544.576651:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265544.576673:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d43c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919312 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265544.576802:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d43ca lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265544.576817:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d43ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265544.576831:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d43ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265544.576843:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789265544.577013:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd200/0xbbfdc9019c1d43c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919312 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265544.577054:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d43ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919312 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265544.577064:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:1.0:1789265544.577067:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789265544.577070:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc200, rc 0) 00000100:00100000:1.0:1789265544.577128:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+27:11438:x1876180556911232:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 502us (912us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789265544.577133:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 145 00000100:00100000:3.0:1789265544.579884:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265544.579988:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556911360 00000100:00100000:0.0:1789265544.580014:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556911360 00000100:00100000:0.0:1789265544.580077:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 146 00000100:00100000:0.0:1789265544.580088:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+27:11438:x1876180556911360:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:0.0:1789265544.580154:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d43d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265544.580184:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d43d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265544.580195:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d43d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265544.580234:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d43d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265544.580242:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d43d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265544.580249:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d43d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265544.580255:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265544.580260:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d43d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265544.580268:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d43d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265544.580279:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:0.0:1789265544.580282:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265544.580286:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d43d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265544.580292:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d43d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265544.580355:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+27:11438:x1876180556911360:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 270us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265544.580365:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 146 00000100:00100000:0.0:1789265544.691241:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579008768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265544.691310:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265544.691436:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579008768 00000100:00100000:3.0:1789265544.691444:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579008768 00000100:00100000:3.0:1789265544.691494:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789265544.691502:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579008768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265544.691538:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789265544.691591:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579008768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265544.691599:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789265544.691646:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579008768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265544.692267:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265544.692279:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579008896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265544.692316:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265544.692390:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579008896 00000100:00100000:2.0:1789265544.692395:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579008896 00000100:00100000:2.0:1789265544.692442:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789265544.692450:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579008896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265544.692472:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265544.692524:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579008896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265544.692531:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789265544.693018:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579008896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265544.697083:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265544.697192:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556911488 00000100:00100000:1.0:1789265544.697201:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556911488 00000100:00100000:1.0:1789265544.697272:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:1.0:1789265544.697283:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556911488:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:1.0:1789265544.697299:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265544.697318:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a17df5a/0xbbfdc9019c1d43df lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919319 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265544.697342:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa60685, atime: 0x6aa60685, ctime: 0x6aa60685, blocks: 0x8 00010000:00010000:1.0:1789265544.697362:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1789265544.697366:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265544.697376:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a17df5a/0xbbfdc9019c1d43df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919319 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265544.697416:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a17df5a/0xbbfdc9019c1d43df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919319 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265544.697440:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd200, rc 0) 00000100:00100000:1.0:1789265544.697501:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2400:x1876180556911488:12345-192.168.202.42@tcp:101:cat.0 Request processed in 220us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265544.697508:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:3.0:1789265544.704392:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265544.704595:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556911616 00000100:00100000:0.0:1789265544.704605:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556911616 00002000:00100000:0.0:1789265544.704656:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff93777f476d80 x1876180556911616/t0(0) o3->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:115/0 lens 488/0 e 0 to 0 dl 1789265555 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265544.704667:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93777f476d80 with x1876180556911616 ext(0->4095) 00002000:00010000:0.0:1789265544.704673:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93777f476d80 00000100:00100000:0.0:1789265544.704708:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:0.0:1789265544.704718:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2400:x1876180556911616:12345-192.168.202.42@tcp:3:cat.0 00000100:00100000:0.0:1789265544.704996:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2400:x1876180556911616:12345-192.168.202.42@tcp:3:cat.0 Request processed in 279us (613us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789265544.705014:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00002000:00100000:0.0:1789265544.705022:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff93777f476d80 x1876180556911616/t0(0) o3->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:115/0 lens 488/4536 e 0 to 0 dl 1789265555 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265544.705031:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93777f476d80 with x1876180556911616 ext(0->4095) 00002000:00010000:0.0:1789265544.705035:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93777f476d80 00010000:00010000:3.0:1789265544.755194:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265545.204432:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579009024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265545.204515:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265545.204661:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579009024 00000100:00100000:0.0:1789265545.204669:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579009024 00000100:00100000:0.0:1789265545.204737:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789265545.204761:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579009024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265545.204793:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265545.204843:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579009024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265545.204850:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789265545.204919:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579009024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265545.205204:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265545.205214:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579009152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265545.205243:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265545.205313:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579009152 00000100:00100000:2.0:1789265545.205318:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579009152 00000100:00100000:2.0:1789265545.205350:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789265545.205358:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579009152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265545.205370:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265545.205413:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579009152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265545.205429:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789265545.205502:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579009152:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789265545.205619:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789265545.587092:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265545.587101:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265545.587151:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789265545.587161:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789265545.779043:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265545.852181:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789265546.804665:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789265547.259040:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1789265547.259179:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93774f1510c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789265547.259183:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93774e508b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93774f151840 00000020:00080000:0.0:1789265547.259186:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93774e508200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93764362f600 00000020:00080000:1.0:1789265547.259228:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:1.0:1789265547.259279:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1789265547.259322:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:2.0:1789265547.261516:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d435a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265547.261539:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d435a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265547.261549:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d435a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265547.261576:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265547.261583:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d435a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265547.261591:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d435a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265547.261614:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff937777820f00) 00010000:00010000:2.0:1789265547.261617:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265547.261623:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d435a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265547.261630:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d435a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265547.269793:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1789265547.269828:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:3.0:1789265547.832135:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265548.285414:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579009536:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.285501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265548.285550:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180579010048:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.285576:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265548.285592:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180579010560:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.285611:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265548.285638:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789265548.285644:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579009664:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.285662:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265548.285676:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579010176:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.285710:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265548.285726:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579010688:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.285743:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265548.285775:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579009536 00000100:00100000:0.0:1789265548.285782:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579009536 00000100:00100000:0.0:1789265548.285824:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789265548.285833:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579009536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.285899:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579009536:12345-0@lo:400:kworker.0 Request processed in 66us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265548.285906:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789265548.285925:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579010048 00000100:00100000:0.0:1789265548.285928:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579010048 00000100:00100000:0.0:1789265548.285958:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579010560 00000100:00100000:0.0:1789265548.285961:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579010560 00000100:00100000:0.0:1789265548.285989:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579009664 00000100:00100000:0.0:1789265548.285992:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579009664 00000100:00100000:0.0:1789265548.286006:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789265548.286012:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180579010048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.286042:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180579010048:12345-0@lo:400:kworker.0 Request processed in 30us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265548.286048:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789265548.286059:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789265548.286064:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180579010560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.286279:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180579010560:12345-0@lo:400:kworker.0 Request processed in 214us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265548.286284:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789265548.286296:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789265548.286302:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579009664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.286327:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579009664:12345-0@lo:400:kworker.0 Request processed in 26us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265548.286333:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789265548.286355:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579010176 00000100:00100000:0.0:1789265548.286358:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579010176 00000100:00100000:0.0:1789265548.286383:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579010688 00000100:00100000:0.0:1789265548.286386:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579010688 00000100:00100000:0.0:1789265548.286404:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789265548.286410:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579010176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.286440:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579010176:12345-0@lo:400:kworker.0 Request processed in 29us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265548.286446:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789265548.286456:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789265548.286461:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579010688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.286487:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579010688:12345-0@lo:400:kworker.0 Request processed in 25us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265548.286493:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789265548.286539:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579009664:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.286550:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579010176:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.286559:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579010688:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.286578:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579009536:0@lo:400:kworker.0 00010000:00080000:0.0:1789265548.286590:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f422300 x1876180579010048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265548.286602:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180579010048:0@lo:400:kworker.0 00010000:00080000:0.0:1789265548.286611:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643d73800 x1876180579010560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265548.286619:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180579010560:0@lo:400:kworker.0 00000100:00100000:3.0:1789265548.287088:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180579009408:0@lo:400:kworker.0 00000100:00100000:3.0:1789265548.287129:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265548.287172:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180579009920:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.287175:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180579009280:0@lo:400:kworker.0 00000100:00100000:3.0:1789265548.287195:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265548.287204:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265548.287214:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180579010432:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.287222:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579009792:0@lo:400:kworker.0 00000100:00100000:3.0:1789265548.287236:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265548.287239:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265548.287252:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579010304:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.287270:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265548.287286:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579010816:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.287302:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265548.287331:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579009280 00000100:00100000:0.0:1789265548.287335:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579009280 00000100:00100000:0.0:1789265548.287365:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1789265548.287373:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3643:x1876180579009280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.287407:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3643:x1876180579009280:12345-0@lo:400:kworker.0 Request processed in 36us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265548.287413:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1789265548.287439:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579009792 00000100:00100000:0.0:1789265548.287448:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579009792 00000100:00100000:0.0:1789265548.287470:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789265548.287597:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579009408 00000100:00100000:3.0:1789265548.287601:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579009408 00000100:00100000:3.0:1789265548.287629:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579009920 00000100:00100000:3.0:1789265548.287631:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579009920 00000100:00100000:3.0:1789265548.287648:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579010432 00000100:00100000:3.0:1789265548.287652:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579010432 00000100:00100000:3.0:1789265548.287667:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789265548.287672:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180579009408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265548.287710:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180579009408:12345-0@lo:400:kworker.0 Request processed in 37us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265548.287715:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789265548.287728:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789265548.287734:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180579009920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265548.287760:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180579009920:12345-0@lo:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265548.287765:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789265548.287770:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579009792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265548.287777:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789265548.287782:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180579010432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265548.287802:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180579010432:12345-0@lo:400:kworker.0 Request processed in 21us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265548.287802:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579009792:12345-0@lo:400:kworker.0 Request processed in 326us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265548.287808:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789265548.287808:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789265548.287830:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579010304 00000100:00100000:0.0:1789265548.287833:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579010304 00000100:00100000:3.0:1789265548.287841:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180579009408:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.287853:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579010816 00000100:00100000:0.0:1789265548.287855:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579010816 00000100:00100000:3.0:1789265548.287889:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180579009920:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.287889:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789265548.287895:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579010304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265548.287898:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180579010432:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.287923:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579010304:12345-0@lo:400:kworker.0 Request processed in 28us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265548.287929:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789265548.287938:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789265548.287944:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579010816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.287983:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579010816:12345-0@lo:400:kworker.0 Request processed in 39us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265548.287988:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789265548.288021:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180579009280:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.288030:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579009792:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.288040:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579010304:0@lo:400:kworker.0 00000100:00100000:0.0:1789265548.288048:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1789265548.288053:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1789265548.288067:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579010816:0@lo:400:kworker.0 00000100:00080000:1.0:1789265548.288206:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265548.288211:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265548.288213:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265548.288215:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265548.787085:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579010944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265548.787199:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265548.787306:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579010944 00000100:00100000:3.0:1789265548.787317:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579010944 00000100:00100000:3.0:1789265548.787382:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789265548.787393:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579010944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265548.787432:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789265548.787484:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579010944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265548.787492:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789265548.787550:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579010944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265548.788206:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265548.788223:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579011072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265548.788269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265548.788350:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579011072 00000100:00100000:0.0:1789265548.788357:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579011072 00000100:00100000:0.0:1789265548.788399:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789265548.788409:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f60a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579011072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265548.788426:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789265548.788468:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f60a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579011072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265548.788476:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789265548.788764:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579011072:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789265548.851940:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265549.062185:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265549.062293:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265549.062334:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265549.062368:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265549.062391:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265549.062407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265549.062429:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265549.062464:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556912000 00000100:00100000:3.0:1789265549.062477:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556912000 00000100:00100000:3.0:1789265549.062584:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556912512 00000100:00100000:3.0:1789265549.062587:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556912512 00000100:00100000:3.0:1789265549.062604:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556911872 00000100:00100000:3.0:1789265549.062607:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556911872 00000100:00100000:3.0:1789265549.062622:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556912384 00000100:00100000:3.0:1789265549.062624:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556912384 00000100:00100000:3.0:1789265549.062642:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 316 00000100:00100000:3.0:1789265549.062654:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556912000:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265549.062747:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556912000:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 95us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265549.062756:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 316 00000100:00100000:3.0:1789265549.062775:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 317 00000100:00100000:1.0:1789265549.062919:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 318 00000100:00100000:1.0:1789265549.062929:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+13:2400:x1876180556911872:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265549.062971:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+13:2400:x1876180556911872:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 34us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265549.062979:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 318 00000100:00100000:1.0:1789265549.062994:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 319 00000100:00100000:1.0:1789265549.063001:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556912384:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265549.063032:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556912384:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 32us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265549.063038:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 319 00000100:00080000:1.0:1789265549.063056:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265549.063060:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265549.063103:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556912256 00000100:00100000:1.0:1789265549.063107:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556912256 00000100:00100000:1.0:1789265549.063139:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556912128 00000100:00100000:1.0:1789265549.063142:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556912128 00000100:00100000:1.0:1789265549.063161:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 154 00000100:00100000:1.0:1789265549.063166:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556912256:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265549.063191:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556912256:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 25us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265549.063198:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 154 00000100:00100000:1.0:1789265549.063209:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 155 00000100:00100000:1.0:1789265549.063214:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556912128:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265549.063232:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556912128:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 18us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265549.063238:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 155 00000100:00080000:1.0:1789265549.063253:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265549.063256:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265549.064744:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556912512:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265549.065430:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556912512:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 2643us (3056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265549.065443:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 317 00000100:00100000:0.0:1789265549.068430:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556911744 00000100:00100000:0.0:1789265549.068458:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556911744 00000100:00100000:0.0:1789265549.068540:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 390 00000100:00100000:0.0:1789265549.068553:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:2400:x1876180556911744:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265549.068658:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:2400:x1876180556911744:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 106us (6486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265549.068666:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 390 00000100:00100000:0.0:1789265549.813115:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579011200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265549.813222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265549.813318:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579011200 00000100:00100000:0.0:1789265549.813327:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579011200 00000100:00100000:0.0:1789265549.813385:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789265549.813394:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579011200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265549.813442:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789265549.813491:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579011200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265549.813516:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789265549.813575:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579011200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265549.822469:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579011328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265549.822566:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265549.822655:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579011328 00000100:00100000:1.0:1789265549.822664:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579011328 00000100:00100000:1.0:1789265549.822721:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789265549.822821:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579011328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265549.822981:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265549.823041:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579011328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 223us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265549.823050:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789265549.823111:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579011328:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789265549.875237:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265550.039372:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265550.039448:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556912640 00000100:00100000:1.0:1789265550.039463:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556912640 00000100:00100000:1.0:1789265550.039570:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 147 00000100:00100000:1.0:1789265550.039581:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+13:11090:x1876180556912640:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789265550.039735:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+13:11090:x1876180556912640:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 Request processed in 154us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265550.039743:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 147 00000100:00100000:1.0:1789265550.064262:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265550.064355:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556912768 00000100:00100000:3.0:1789265550.064368:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556912768 00000100:00100000:3.0:1789265550.064450:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 148 00000100:00100000:3.0:1789265550.064463:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:11090:x1876180556912768:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789265550.064608:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:11090:x1876180556912768:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 Request processed in 147us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265550.064616:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 148 00000100:00100000:3.0:1789265550.075123:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265550.075305:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556913024 00000100:00100000:0.0:1789265550.075320:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556913024 00000100:00100000:0.0:1789265550.075405:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:0.0:1789265550.075417:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+13:11090:x1876180556913024:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789265550.075751:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+14:11090:x1876180556913024:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 334us (641us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789265550.075760:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:0.0:1789265550.324723:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265550.324763:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579011456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265550.324892:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265550.324922:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265550.324935:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579011584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265550.324986:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265550.325015:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579011456 00000100:00100000:0.0:1789265550.325024:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579011456 00000100:00080000:1.0:1789265550.325082:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265550.325093:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579011584 00000100:00100000:0.0:1789265550.325097:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579011584 00000100:00100000:0.0:1789265550.325128:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789265550.325138:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579011456:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789265550.325154:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789265550.325175:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789265550.325237:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579011456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265550.325316:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579011456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265550.331927:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789265550.332171:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579011584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265550.332367:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265550.332649:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579011584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 500us (7660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265550.332659:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789265550.333148:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579011584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265550.341728:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789265550.488683:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265550.488917:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556913152 00000100:00100000:3.0:1789265550.488930:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556913152 00000100:00100000:3.0:1789265550.489075:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 149 00000100:00100000:3.0:1789265550.489090:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:11896:x1876180556913152:12345-192.168.202.42@tcp:101:lsof.0 00010000:00010000:3.0:1789265550.489118:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265550.489149:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d43e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919320 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265550.489237:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d43ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265550.489256:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d43ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265550.489275:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d43ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265550.489336:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265550.489340:0:14174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265550.489389:0:14174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d43ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265550.489417:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d43e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919320 expref: 7 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265550.489439:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d43ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919320 expref: 6 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265550.489466:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d90300) 00010000:00010000:3.0:1789265550.489469:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265550.489473:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a4e00, rc 0) 00000100:00100000:3.0:1789265550.489556:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:11896:x1876180556913152:12345-192.168.202.42@tcp:101:lsof.0 Request processed in 470us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265550.489563:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 149 00010000:00010000:3.0:1789265550.899186:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265551.928201:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265552.947169:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265553.395506:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180579011712:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.395581:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265553.395642:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579012224:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.395668:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265553.395688:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579012736:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.395711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265553.395728:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579013248:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.395749:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265553.395774:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789265553.395779:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180579012096:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.395802:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265553.395818:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579012608:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.395838:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265553.395852:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579013120:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.395898:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265553.396174:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579011840:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.396201:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265553.396271:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180579012352:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.396300:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1789265553.398578:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1789265553.398601:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000100:00100000:1.0:1789265553.407155:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579011968:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.407236:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265553.407264:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180579012480:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.407291:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265553.407343:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579012096 00000100:00100000:2.0:1789265553.407350:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579012096 00000100:00100000:2.0:1789265553.408353:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579011840 00000100:00100000:2.0:1789265553.408368:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579011840 00000100:00100000:2.0:1789265553.408395:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579012352 00000100:00100000:2.0:1789265553.408398:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579012352 00000100:00100000:2.0:1789265553.408433:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789265553.408445:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180579012096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265553.408561:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180579012096:12345-0@lo:400:kworker.0 Request processed in 118us (12757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265553.408590:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789265553.408610:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789265553.408616:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579011840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265553.408648:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579011840:12345-0@lo:400:kworker.0 Request processed in 32us (12446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265553.408654:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789265553.408664:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789265553.408670:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180579012352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265553.408697:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180579012352:12345-0@lo:400:kworker.0 Request processed in 27us (12398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265553.408703:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:2.0:1789265553.408725:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265553.408774:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180579012096:0@lo:400:kworker.0 00000100:00100000:0.0:1789265553.410120:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579012736 00000020:00080000:2.0:1789265553.410344:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789265553.410369:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789265553.410382:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579013248 00000100:00100000:2.0:1789265553.410387:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579013248 00000100:00100000:2.0:1789265553.410454:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579012608 00000100:00100000:2.0:1789265553.410458:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579012608 00000100:00100000:2.0:1789265553.410474:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579013120 00000100:00100000:2.0:1789265553.410478:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579013120 00000100:00100000:2.0:1789265553.410501:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789265553.410513:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579013248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265553.410615:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579013248:12345-0@lo:400:kworker.0 Request processed in 103us (14862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265553.410624:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789265553.410659:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789265553.410666:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579012608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265553.410704:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579012608:12345-0@lo:400:kworker.0 Request processed in 39us (14865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265553.410710:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789265553.410722:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789265553.410730:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579013120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265553.410759:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579013120:12345-0@lo:400:kworker.0 Request processed in 31us (14860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265553.410764:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1789265553.410785:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265553.410790:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265553.410829:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579012608:0@lo:400:kworker.0 00000100:00100000:2.0:1789265553.410846:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579013120:0@lo:400:kworker.0 00000100:00100000:2.0:1789265553.410908:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579013248:0@lo:400:kworker.0 00000100:00100000:0.0:1789265553.412087:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579012736 00000100:00100000:0.0:1789265553.412198:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789265553.412209:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579012736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265553.412307:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579012736:12345-0@lo:400:kworker.0 Request processed in 100us (16594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265553.412314:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789265553.412351:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579012224 00000100:00100000:0.0:1789265553.412359:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579012224 00000100:00100000:0.0:1789265553.412400:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579011968 00000100:00100000:0.0:1789265553.412403:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579011968 00000100:00100000:0.0:1789265553.412421:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789265553.412428:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579012224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265553.412467:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579012224:12345-0@lo:400:kworker.0 Request processed in 38us (16796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265553.412474:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789265553.412489:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789265553.412495:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579011968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265553.412541:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579011968:12345-0@lo:400:kworker.0 Request processed in 43us (5302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265553.412549:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789265553.412581:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579011712 00000100:00100000:0.0:1789265553.412586:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579011712 00000100:00100000:0.0:1789265553.412619:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1789265553.412630:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180579011712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265553.412673:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180579011712:12345-0@lo:400:kworker.0 Request processed in 45us (17090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265553.412698:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00080000:2.0:1789265553.412908:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265553.413560:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180579012352:0@lo:400:kworker.0 00000100:00100000:3.0:1789265553.413576:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180579012864:0@lo:400:kworker.0 00000100:00100000:2.0:1789265553.414087:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180579011712:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.414129:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265553.414191:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579011840:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.414221:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579012480 00000100:00100000:1.0:1789265553.414236:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579012480 00000100:00100000:1.0:1789265553.414285:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579012864 00000100:00100000:1.0:1789265553.414288:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579012864 00000100:00100000:1.0:1789265553.414312:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789265553.414320:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180579012480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.414373:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180579012480:12345-0@lo:400:kworker.0 Request processed in 54us (7081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265553.414381:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789265553.414398:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789265553.414404:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180579012864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.414436:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180579012864:12345-0@lo:400:kworker.0 Request processed in 33us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265553.414442:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:1.0:1789265553.414457:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265553.414460:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265553.414479:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180579012864:0@lo:400:kworker.0 00010000:00080000:1.0:1789265553.414507:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643df2d80 x1876180579012480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265553.414518:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180579012480:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.414526:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180579012992:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.414555:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265553.414577:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579012992 00000100:00100000:1.0:1789265553.414580:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579012992 00000100:00100000:1.0:1789265553.414607:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789265553.414612:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180579012992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.414639:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876180579012992:12345-0@lo:400:kworker.0 Request processed in 27us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265553.414650:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00080000:1.0:1789265553.414668:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789265553.414684:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937643df0000 x1876180579012992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265553.414694:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180579012992:0@lo:400:kworker.0 00000100:00100000:1.0:1789265553.414715:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579011968:0@lo:400:kworker.0 00000100:00100000:3.0:1789265553.414808:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579012224:0@lo:400:kworker.0 00000100:00100000:3.0:1789265553.414823:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579012736:0@lo:400:kworker.0 00000001:02000400:1.0:1789265553.503749:0:14512:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:12:32 (1789265552) 00000100:00100000:2.0:1789265553.909398:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265553.909433:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579013376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265553.909534:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265553.910459:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579013376 00000100:00100000:3.0:1789265553.910475:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579013376 00000100:00100000:3.0:1789265553.910559:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789265553.910572:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579013376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265553.910623:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789265553.911397:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265553.911417:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579013504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265553.911501:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265553.912540:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579013504 00000100:00100000:0.0:1789265553.912555:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579013504 00000100:00100000:0.0:1789265553.912613:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789265553.912624:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579013504:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265553.912966:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579013376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2394us (3429us total) trans 0 rc 0/0 00002000:00000024:0.0:1789265553.913944:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789265553.914082:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789265553.914251:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579013376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265553.914493:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579013504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1869us (2990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265553.914502:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789265553.914850:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579013504:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789265553.973933:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265554.173283:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265554.173334:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265554.173367:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265554.173404:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265554.173432:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265554.173451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265554.173472:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265554.173500:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556913280 00000100:00100000:1.0:1789265554.173510:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556913280 00000100:00100000:0.0:1789265554.173627:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556913408 00000100:00100000:0.0:1789265554.173632:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556913408 00000100:00100000:0.0:1789265554.173691:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556913920 00000100:00100000:0.0:1789265554.173694:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556913920 00000100:00100000:0.0:1789265554.173711:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556913536 00000100:00100000:0.0:1789265554.173714:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556913536 00000100:00100000:0.0:1789265554.173727:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556914048 00000100:00100000:0.0:1789265554.173729:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556914048 00000100:00100000:0.0:1789265554.173760:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 326 00000100:00100000:0.0:1789265554.173772:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+13:2400:x1876180556913408:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265554.173942:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+13:2400:x1876180556913408:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 172us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.173950:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 326 00000100:00100000:0.0:1789265554.173968:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 327 00000100:00100000:0.0:1789265554.173975:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2400:x1876180556913920:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265554.174011:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2400:x1876180556913920:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 36us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.174034:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 327 00000100:00100000:0.0:1789265554.174047:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 328 00000100:00100000:0.0:1789265554.174053:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556913536:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265554.174083:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556913536:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 30us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.174088:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 328 00000100:00100000:0.0:1789265554.174099:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 329 00000100:00100000:0.0:1789265554.174105:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f46a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556914048:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265554.174131:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f46a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556914048:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 27us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.174138:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 329 00000100:00100000:0.0:1789265554.174160:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556913664 00000100:00100000:0.0:1789265554.174164:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556913664 00000100:00100000:0.0:1789265554.174191:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556913792 00000100:00100000:0.0:1789265554.174194:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556913792 00000100:00100000:0.0:1789265554.174212:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 160 00000100:00100000:0.0:1789265554.174219:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556913664:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265554.174244:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556913664:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 25us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.174250:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 160 00000100:00100000:0.0:1789265554.174261:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 161 00000100:00100000:0.0:1789265554.174266:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556913792:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265554.174287:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556913792:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.174299:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 161 00000100:00080000:0.0:1789265554.174315:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265554.174319:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265554.174321:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265554.174323:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265554.177504:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 392 00000100:00100000:1.0:1789265554.177531:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2400:x1876180556913280:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265554.177617:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2400:x1876180556913280:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 100us (4210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265554.177643:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 392 00000100:00100000:1.0:1789265554.931238:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579013632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265554.931330:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265554.931673:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579013632 00000100:00100000:0.0:1789265554.931681:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579013632 00000100:00100000:0.0:1789265554.931741:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789265554.931751:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579013632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265554.931787:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789265554.931840:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579013632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.931848:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789265554.932186:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579013760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265554.932220:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265554.932791:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579013632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265554.932888:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579013760 00000100:00100000:0.0:1789265554.932894:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579013760 00000100:00100000:0.0:1789265554.933399:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789265554.933482:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579013760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265554.933514:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789265554.933583:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579013760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.933591:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789265554.933703:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579013760:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789265554.995221:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265555.059833:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789265555.238691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265555.242194:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556914304 00000100:00100000:0.0:1789265555.242209:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556914304 00000100:00100000:0.0:1789265555.242293:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 150 00000100:00100000:0.0:1789265555.242304:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+13:12163:x1876180556914304:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265555.242328:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265555.242368:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d43f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919327 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242463:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d43fb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242479:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d43fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242492:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d43fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242508:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4402 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242515:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4402 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242522:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4402 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242629:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4409 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242638:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4409 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242645:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4409 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265555.242655:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789265555.242744:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d43fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242761:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d43fb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242768:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d43fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242774:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265555.242778:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d43fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242785:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d43fb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242797:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93774712fb00) 00010000:00010000:0.0:1789265555.242799:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265555.242804:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d43fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242811:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d43fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242825:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4402 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242831:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4402 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242837:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4402 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.242842:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265555.242851:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4402 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.243178:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4402 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.243188:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff937779d97d00) 00010000:00010000:0.0:1789265555.243190:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265555.243193:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4402 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.243199:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4402 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.246339:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d43f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919327 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.246365:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4409 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919327 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.246375:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93774712f300) 00010000:00010000:0.0:1789265555.246378:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265555.246381:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392600, rc 0) 00000100:00100000:0.0:1789265555.249477:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+15:12163:x1876180556914304:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 7161us (10785us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789265555.249491:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 150 00000100:00100000:3.0:1789265555.251548:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265555.251920:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556914432 00000100:00100000:0.0:1789265555.251937:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556914432 00000100:00100000:0.0:1789265555.252008:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:0.0:1789265555.252018:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+15:2397:x1876180556914432:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265555.252059:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265555.252091:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4409 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919327 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265555.252117:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93774712f300) 00010000:00010000:0.0:1789265555.252122:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265555.252193:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+14:2397:x1876180556914432:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 177us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265555.252200:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:1.0:1789265555.260604:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265555.260688:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556914560 00000100:00100000:0.0:1789265555.260700:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556914560 00000100:00100000:0.0:1789265555.260772:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 151 00000100:00100000:0.0:1789265555.260782:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+14:12163:x1876180556914560:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789265555.260936:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+14:12163:x1876180556914560:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 Request processed in 155us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265555.260944:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 151 00000100:00100000:1.0:1789265555.263963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265555.264115:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556914688 00000100:00100000:3.0:1789265555.264133:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556914688 00000100:00100000:3.0:1789265555.264195:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 152 00000100:00100000:3.0:1789265555.264206:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:12163:x1876180556914688:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789265555.264325:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:12163:x1876180556914688:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 Request processed in 121us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265555.264333:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 152 00000100:00100000:1.0:1789265555.446090:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265555.446125:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579013888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265555.446230:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265555.446320:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579013888 00000100:00100000:1.0:1789265555.446333:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579013888 00000100:00080000:0.0:1789265555.446390:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265555.446408:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789265555.446419:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579013888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265555.446462:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265555.446528:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579013888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265555.446536:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789265555.447264:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265555.447280:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579014016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265555.447331:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265555.448686:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579013888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265555.455330:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579014016 00000100:00100000:2.0:1789265555.455354:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579014016 00000100:00100000:2.0:1789265555.455484:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789265555.455497:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579014016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265555.455536:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265555.455668:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579014016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (8336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265555.455676:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789265555.455787:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579014016:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789265555.458112:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789265555.831171:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265555.831187:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265555.831319:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1789265555.831341:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789265556.019162:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265556.092078:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265557.043159:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265557.863058:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265557.864020:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556914816 00000100:00100000:0.0:1789265557.864033:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556914816 00000100:00100000:0.0:1789265557.864135:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 153 00000100:00100000:0.0:1789265557.864148:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+14:12205:x1876180556914816:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1789265557.864173:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265557.864196:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4417 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91932e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864273:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d441e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864288:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d441e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864303:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d441e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864318:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4425 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864325:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864331:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864375:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d441e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864383:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d441e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864390:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d441e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864396:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265557.864400:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d441e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864415:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d441e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864427:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d90300) 00010000:00010000:0.0:1789265557.864430:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265557.864435:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d441e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864441:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d441e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864451:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864457:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4425 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864463:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4425 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864469:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265557.864471:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4425 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864477:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4425 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864485:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff937779d97a00) 00010000:00010000:0.0:1789265557.864487:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265557.864490:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4425 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864503:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4425 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864547:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4417 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91932e expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864557:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d90300) 00010000:00010000:0.0:1789265557.864559:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265557.864563:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4417 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91932e expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.864572:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392600, rc 0) 00000100:00100000:0.0:1789265557.864650:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+14:12205:x1876180556914816:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 505us (1603us total) trans 0 rc 301/301 00000100:00100000:0.0:1789265557.864657:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 153 00000100:00080000:3.0:1789265557.865466:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265557.879839:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265557.879980:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556915072 00000100:00100000:3.0:1789265557.879990:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556915072 00000100:00100000:3.0:1789265557.880046:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 154 00000100:00100000:3.0:1789265557.880056:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+14:12205:x1876180556915072:12345-192.168.202.42@tcp:36:lfs.0 00010000:00010000:3.0:1789265557.880107:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265557.880132:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d3d6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919152 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.880148:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d90300) 00010000:00010000:3.0:1789265557.880153:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265557.880210:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.880224:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d43ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919320 expref: 5 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.880242:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.880279:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d43ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919320 expref: 5 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.880291:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d43ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919320 expref: 5 pid: 14174 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265557.880306:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f464a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579014144:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265557.880383:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d7840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265557.883226:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f464a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579014144:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265557.883255:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265557.886595:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265557.886894:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556915200 00000100:00100000:0.0:1789265557.886904:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556915200 00010000:00010000:0.0:1789265557.887088:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d43ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919320 expref: 6 pid: 14174 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265557.887125:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 81 00000100:00080000:1.0:1789265557.887187:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265557.887227:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2400:x1876180556915200:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265557.887242:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265557.887250:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d43ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919320 expref: 6 pid: 14174 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.887275:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d43ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919320 expref: 6 pid: 14174 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.887296:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d43ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919320 expref: 6 pid: 14174 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.887310:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d90300) 00010000:00010000:0.0:1789265557.887314:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.887323:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.887330:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.887365:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265557.887420:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556915200:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 195us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265557.887427:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 81 00010000:00010000:3.0:1789265557.888078:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.888089:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.888111:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4433 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.888121:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4433 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.888131:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4433 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.889001:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d443a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.889013:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d443a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.889022:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d443a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265557.889045:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061209a97 reply state 00000000d35e25d9 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d443a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.889057:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d443a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.889064:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:3.0:1789265557.889066:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265557.889069:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789265557.889074:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789265557.889082:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.889088:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.889093:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.889099:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265557.889102:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.889109:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.889118:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d90300) 00010000:00010000:3.0:1789265557.889120:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265557.889124:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.889138:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d442c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265557.889158:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061209a97 reply state 00000000d35e25d9 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4433 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.889166:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4433 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.889172:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93774e575b00) 00010000:00010000:3.0:1789265557.889175:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265557.889177:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789265557.889514:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+15:12205:x1876180556915072:12345-192.168.202.42@tcp:36:lfs.0 Request processed in 9455us (9677us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789265557.889523:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 154 00000100:00100000:1.0:1789265557.989666:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265557.990098:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556915328 00000100:00100000:0.0:1789265557.990108:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556915328 00000100:00100000:0.0:1789265557.990173:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 155 00000100:00100000:0.0:1789265557.990184:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+15:12213:x1876180556915328:12345-192.168.202.42@tcp:101:lctl.0 00010000:00010000:0.0:1789265557.990208:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265557.990230:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4441 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919335 expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.990321:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4448 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.990336:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.990348:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265557.990398:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789265557.990402:0:9988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265557.990423:0:9988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.990447:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4441 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919335 expref: 17 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.990466:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4448 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919335 expref: 16 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.990476:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d97a00) 00010000:00010000:0.0:1789265557.990479:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265557.990482:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393800, rc 0) 00000100:00100000:0.0:1789265557.990613:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+16:12213:x1876180556915328:12345-192.168.202.42@tcp:101:lctl.0 Request processed in 430us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265557.990621:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 155 00010000:00010000:1.0:1789265558.067055:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265558.072243:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265558.073926:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556915456 00000100:00100000:0.0:1789265558.073941:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556915456 00000100:00100000:0.0:1789265558.074020:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 156 00000100:00100000:0.0:1789265558.074031:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+16:12219:x1876180556915456:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1789265558.074051:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265558.074071:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d444f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91933c expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074135:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4456 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074148:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074160:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074169:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d445d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074176:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d445d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074182:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d445d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074270:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d4464 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074278:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d4464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074285:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d4464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265558.074336:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789265558.074340:0:14174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265558.074367:0:14174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d4464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074379:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074386:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4456 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074393:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4456 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074398:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392e00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265558.074403:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4456 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074410:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4456 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074426:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d97a00) 00010000:00010000:0.0:1789265558.074429:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265558.074434:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4456 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074440:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d4456 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074454:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d445d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074470:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d445d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074476:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d445d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074482:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265558.074486:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d445d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074493:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d445d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074502:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93774e575b00) 00010000:00010000:0.0:1789265558.074505:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265558.074507:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d445d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074513:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d445d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074541:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d444f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91933c expref: 18 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074555:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d4464 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91933c expref: 17 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.074562:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:0.0:1789265558.074564:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789265558.074572:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393200, rc 0) 00000100:00100000:0.0:1789265558.074944:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+17:12219:x1876180556915456:12345-192.168.202.42@tcp:101:bash.0 Request processed in 912us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265558.074952:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 156 00000100:00100000:0.0:1789265558.082760:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265558.082854:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556915712 00000100:00100000:3.0:1789265558.082913:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556915712 00000100:00100000:3.0:1789265558.082977:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 157 00000100:00100000:3.0:1789265558.082988:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+17:12219:x1876180556915712:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1789265558.083009:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265558.083030:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d446b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919343 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083142:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4472 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083158:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4472 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083187:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4472 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083243:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4479 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083251:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4479 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083259:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4479 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265558.083584:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789265558.083719:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4480 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083729:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083737:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083773:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4472 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083781:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4472 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083787:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4472 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083793:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265558.083804:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4472 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083813:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4472 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083825:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:3.0:1789265558.083828:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265558.083832:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4472 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083839:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4472 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265558.083854:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019edd18d reply state 000000004fdf3bb4 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4479 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083941:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4479 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.083948:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575300) 00010000:00010000:3.0:1789265558.083951:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265558.083953:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789265558.083987:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d446b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919343 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.084000:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919343 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.084007:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575e00) 00010000:00010000:3.0:1789265558.084009:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265558.084017:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a5c00, rc 0) 00000100:00100000:3.0:1789265558.084080:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+20:12219:x1876180556915712:12345-192.168.202.42@tcp:101:bash.0 Request processed in 1094us (1332us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789265558.084087:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 157 00000100:00100000:2.0:1789265558.090113:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265558.090166:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556915840 00000100:00100000:0.0:1789265558.090177:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556915840 00000100:00100000:0.0:1789265558.090319:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:0.0:1789265558.090331:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556915840:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1789265558.090350:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265558.090371:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000700780c2/0xbbfdc9019c1d448e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91934a expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789265558.090394:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265558.090412:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1789265558.090417:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265558.090426:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000700780c2/0xbbfdc9019c1d448e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91934a expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.090444:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000700780c2/0xbbfdc9019c1d448e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91934a expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.090456:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393c00, rc 0) 00000100:00100000:0.0:1789265558.090520:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2399:x1876180556915840:12345-192.168.202.42@tcp:101:bash.0 Request processed in 192us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265558.090526:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00080000:1.0:1789265558.091794:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265558.095164:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265558.095288:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556915968 00000100:00100000:2.0:1789265558.095298:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556915968 00000100:00100000:2.0:1789265558.095363:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:2.0:1789265558.095373:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:12219:x1876180556915968:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1789265558.095391:0:9789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265558.095409:0:9789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919351 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.095442:0:9789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000700780c2/0xbbfdc9019c1d448e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91934a expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.095453:0:9789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265558.095457:0:9789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265558.095477:0:9789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 7 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.095513:0:9789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000700780c2/0xbbfdc9019c1d448e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91934a expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.095527:0:9789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000700780c2/0xbbfdc9019c1d448e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91934a expref: 7 pid: 8435 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265558.095542:0:9789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9789:1876180579014272:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265558.096037:0:9789:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e787f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265558.099581:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265558.099715:0:9789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9789:1876180579014272:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265558.099749:0:9789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 7 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.099771:0:9789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc000, rc 0) 00000100:00100000:2.0:1789265558.099838:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+7:12219:x1876180556915968:12345-192.168.202.42@tcp:101:bash.0 Request processed in 4467us (4684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265558.099847:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:0.0:1789265558.100145:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556916096 00000100:00100000:0.0:1789265558.100167:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556916096 00010000:00010000:0.0:1789265558.100198:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000700780c2/0xbbfdc9019c1d448e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91934a expref: 7 pid: 8435 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265558.100226:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 82 00000100:00100000:0.0:1789265558.100235:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f466d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2400:x1876180556916096:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265558.100248:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265558.100270:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000700780c2/0xbbfdc9019c1d448e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91934a expref: 7 pid: 8435 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.100283:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000700780c2/0xbbfdc9019c1d448e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91934a expref: 7 pid: 8435 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.100304:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000700780c2/0xbbfdc9019c1d448e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91934a expref: 7 pid: 8435 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.100319:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265558.100323:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265558.100331:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 6 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.100339:0:7460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 6 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.100371:0:7460:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 6 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265558.100395:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7460:1876180579014400:192.168.202.42@tcp:105: 00000100:00100000:0.0:1789265558.100449:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set ffff93777aae6540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265558.109844:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265558.110125:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7460:1876180579014400:192.168.202.42@tcp:105: 00010000:00010000:0.0:1789265558.110149:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265558.110218:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f466d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2400:x1876180556916096:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 9983us (10657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265558.110228:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 82 00000100:00100000:3.0:1789265558.110360:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556916352 00000100:00100000:3.0:1789265558.110368:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556916352 00000100:00100000:3.0:1789265558.110419:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:3.0:1789265558.110429:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+20:12219:x1876180556916352:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:3.0:1789265558.110684:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+21:12219:x1876180556916352:12345-192.168.202.42@tcp:35:bash.0 Request processed in 256us (851us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789265558.110691:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:1.0:1789265558.217495:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265558.218059:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556916608 00000100:00100000:0.0:1789265558.218069:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556916608 00000100:00100000:0.0:1789265558.218124:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 158 00000100:00100000:0.0:1789265558.218132:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+21:12229:x1876180556916608:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1789265558.218151:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265558.218168:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d449c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919358 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265558.218259:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789265558.218357:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d449c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919358 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.218369:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d97a00) 00010000:00010000:0.0:1789265558.218371:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265558.218375:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d449c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919358 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.218385:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393c00, rc 0) 00000100:00100000:0.0:1789265558.218457:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+22:12229:x1876180556916608:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 326us (973us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1789265558.218464:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 158 00000100:00100000:1.0:1789265558.226352:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265558.226703:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556916864 00000100:00100000:3.0:1789265558.226715:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556916864 00000100:00100000:3.0:1789265558.226846:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:3.0:1789265558.226917:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+22:12229:x1876180556916864:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1789265558.227186:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+23:12229:x1876180556916864:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 328us (842us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789265558.227194:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:2.0:1789265558.293469:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265558.293607:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556916992 00000100:00100000:0.0:1789265558.293617:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556916992 00000100:00100000:0.0:1789265558.293676:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 159 00000100:00100000:0.0:1789265558.293685:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+23:12235:x1876180556916992:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1789265558.293708:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265558.293730:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91935f expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.293935:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d44b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.293950:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d44b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.294032:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d44b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265558.294080:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789265558.294084:0:14174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265558.294102:0:14174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d44b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.294129:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91935f expref: 25 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.294148:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d44b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91935f expref: 24 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.294175:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:0.0:1789265558.294178:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265558.294181:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392600, rc 0) 00000100:00100000:0.0:1789265558.294551:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+24:12235:x1876180556916992:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 864us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265558.294559:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 159 00000100:00100000:1.0:1789265558.301387:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265558.301490:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556917248 00000100:00100000:0.0:1789265558.301500:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556917248 00000100:00100000:0.0:1789265558.301563:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 160 00000100:00100000:0.0:1789265558.301573:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+24:12235:x1876180556917248:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1789265558.301596:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265558.301617:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919366 expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.301726:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d44bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.301740:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d44bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.301766:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d44bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265558.301778:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789265558.301928:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919366 expref: 27 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.302626:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d44bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919366 expref: 26 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.302638:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575e00) 00010000:00010000:0.0:1789265558.302641:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265558.302644:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392e00, rc 0) 00000100:00100000:0.0:1789265558.302719:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+26:12235:x1876180556917248:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 1147us (1342us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1789265558.302727:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 160 00000100:00100000:1.0:1789265558.319434:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265558.319484:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265558.319580:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556917632 00000100:00100000:0.0:1789265558.319593:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556917632 00000100:00100000:0.0:1789265558.319667:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:0.0:1789265558.319677:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+26:2400:x1876180556917632:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265558.319694:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265558.319719:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d44bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919366 expref: 26 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.319740:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575e00) 00010000:00010000:0.0:1789265558.319757:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265558.319822:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+25:2400:x1876180556917632:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 146us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265558.319829:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:3.0:1789265558.320784:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556917504 00000100:00100000:3.0:1789265558.320794:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556917504 00000100:00100000:3.0:1789265558.320849:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 161 00000100:00100000:3.0:1789265558.320904:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+25:12235:x1876180556917504:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265558.320927:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265558.320950:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d44cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91936d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.321547:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d44d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.321562:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d44d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.321575:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d44d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265558.321588:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789265558.321686:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d44cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91936d expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.321706:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d44d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91936d expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.321715:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575e00) 00010000:00010000:3.0:1789265558.321718:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789265558.321721:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a5400, rc 0) 00000100:00100000:3.0:1789265558.321933:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+27:12235:x1876180556917504:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 1075us (2507us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1789265558.321941:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 161 00000100:00100000:1.0:1789265558.339060:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265558.339516:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556917760 00000100:00100000:0.0:1789265558.339528:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556917760 00000100:00100000:0.0:1789265558.339599:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:0.0:1789265558.339624:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2397:x1876180556917760:12345-192.168.202.42@tcp:1:lfs.0 00010000:00010000:0.0:1789265558.339672:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007390bbc6/0xbbfdc9019c1d44e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.339708:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 6 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.339717:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265558.339722:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265558.339726:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007390bbc6/0xbbfdc9019c1d44e2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.339763:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 6 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.339778:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 6 pid: 9789 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265558.339793:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1876180579014528:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265558.340069:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775235a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265558.347112:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265558.347247:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1876180579014528:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265558.347410:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007390bbc6/0xbbfdc9019c1d44e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265558.347489:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556917888 00000100:00100000:3.0:1789265558.347497:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556917888 00002000:00100000:3.0:1789265558.347547:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff937643d13100 x1876180556917888/t0(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:129/0 lens 504/0 e 0 to 0 dl 1789265569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265558.347556:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff937643d13100 with x1876180556917888 ext(0->12) 00010000:00010000:3.0:1789265558.347575:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 7 pid: 9789 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.347589:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 7 pid: 9789 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265558.347596:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff937643d13100 00000100:00100000:3.0:1789265558.347640:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:3.0:1789265558.347651:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556917888:12345-192.168.202.42@tcp:4:lfs.0 00000100:00100000:3.0:1789265558.350457:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2399:x1876180556917888:12345-192.168.202.42@tcp:4:lfs.0 Request processed in 2798us (3346us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789265558.350472:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 2 00002000:00100000:3.0:1789265558.350484:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff937643d13100 x1876180556917888/t4294967306(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:129/0 lens 504/448 e 0 to 0 dl 1789265569 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265558.350494:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff937643d13100 with x1876180556917888 ext(0->12) 00010000:00010000:3.0:1789265558.350504:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 9 pid: 9789 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.350525:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 9 pid: 9789 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265558.350533:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff937643d13100 00000100:00100000:1.0:1789265558.362487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265558.366426:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556918016 00000100:00100000:3.0:1789265558.366442:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556918016 00010000:00010000:3.0:1789265558.366498:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 9 pid: 9789 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265558.366560:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 83 00000100:00100000:3.0:1789265558.366571:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2398:x1876180556918016:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265558.366588:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789265558.366612:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789265558.366615:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789265559 00002000:00010000:3.0:1789265558.366617:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789265559 00002000:00010000:3.0:1789265558.366620:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789265559 00002000:00010000:3.0:1789265558.366622:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789265558.366629:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 9 pid: 9789 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.366645:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 9 pid: 9789 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.366670:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000596c6e71/0xbbfdc9019c1d4495 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919351 expref: 9 pid: 9789 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.366687:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1789265558.366692:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265558.366698:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007390bbc6/0xbbfdc9019c1d44e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.366708:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007390bbc6/0xbbfdc9019c1d44e2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.366832:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265558.366948:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2398:x1876180556918016:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 378us (4472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265558.366956:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 83 00010000:00010000:1.0:1789265558.368774:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007390bbc6/0xbbfdc9019c1d44e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.368792:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007390bbc6/0xbbfdc9019c1d44e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.368823:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007390bbc6/0xbbfdc9019c1d44e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.368833:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007390bbc6/0xbbfdc9019c1d44e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.369748:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007390bbc6/0xbbfdc9019c1d44e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.369759:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392e00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265558.369764:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007390bbc6/0xbbfdc9019c1d44e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.369774:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007390bbc6/0xbbfdc9019c1d44e2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.369793:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007390bbc6/0xbbfdc9019c1d44e2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.369801:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007390bbc6/0xbbfdc9019c1d44e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265558.370156:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2397:x1876180556917760:12345-192.168.202.42@tcp:1:lfs.0 Request processed in 30530us (31103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265558.370167:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:1.0:1789265558.379471:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265558.379570:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556918272 00000100:00100000:0.0:1789265558.379579:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556918272 00000100:00100000:0.0:1789265558.379653:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:0.0:1789265558.379665:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779d30450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+27:12235:x1876180556918272:12345-192.168.202.42@tcp:35:lfs.0 00000004:00010000:0.0:1789265558.379741:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d44d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91936d expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265558.380021:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1789265558.380056:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789265558.381091:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1789265558.381146:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.381168:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4480 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919343 expref: 31 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.381178:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.381214:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919343 expref: 31 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.381232:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4480 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919343 expref: 31 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265558.381247:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d70700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1876180579014656:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265558.381577:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775235a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265558.388329:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265558.388462:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556918400 00000100:00100000:1.0:1789265558.388471:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556918400 00010000:00010000:1.0:1789265558.388513:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4480 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919343 expref: 32 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265558.388592:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 84 00000100:00100000:1.0:1789265558.388602:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+32:2400:x1876180556918400:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265558.388620:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265558.388627:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4480 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919343 expref: 32 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.388639:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4480 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919343 expref: 32 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.388663:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575e00) 00010000:00010000:1.0:1789265558.388670:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.388679:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.388687:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.388706:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265558.388766:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+32:2400:x1876180556918400:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 165us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265558.388774:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 84 00010000:00010000:0.0:1789265558.389969:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4480 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919343 expref: 31 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265558.389994:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d70700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1876180579014656:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265558.390028:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.390037:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.390043:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789265558.390160:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1789265558.390444:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1789265558.390527:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d70700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876180579014784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789265558.390599:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265558.390689:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775235a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265558.392298:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579014784 00000100:00100000:3.0:1789265558.392312:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579014784 00000100:00100000:0.0:1789265558.392832:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789265558.392845:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1876180579014784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789265558.393203:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1876180579014784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 360us (2602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265558.393210:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:1.0:1789265558.393366:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265558.393440:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d70700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876180579014784:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789265558.393600:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1789265558.393669:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f466a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876180579014912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789265558.393707:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265558.394481:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579014912 00000100:00100000:2.0:1789265558.394491:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579014912 00000100:00100000:2.0:1789265558.394543:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789265558.394554:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1876180579014912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789265558.394695:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6522:x1876180579014912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 143us (987us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789265558.394716:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789265558.396445:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff937756f0dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265558.396491:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f466a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876180579014912:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789265558.396566:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1789265558.396620:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.396631:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.396638:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.396654:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265558.396659:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.396667:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.396682:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575e00) 00010000:00010000:0.0:1789265558.396686:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789265558.396691:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.396697:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d44e9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789265558.396805:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789265558.397097:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1789265558.397110:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 414058249893ns, next at 415058247395ns, rc = 0 00000001:00080000:0.0:1789265558.397117:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1789265558.397140:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575e00) 00010000:00010000:0.0:1789265558.397143:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789265558.397151:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d44d4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91936d expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265558.397569:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779d30450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+34:12235:x1876180556918272:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 17905us (18106us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1789265558.397579:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 38 00000020:00080000:0.0:1789265558.397585:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789265558.407197:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265558.407289:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556918528 00000100:00100000:0.0:1789265558.407300:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556918528 00000100:00100000:0.0:1789265558.407364:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 162 00000100:00100000:0.0:1789265558.407375:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+34:12235:x1876180556918528:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1789265558.407400:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265558.407424:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d44f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919374 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.407480:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d44f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919374 expref: 35 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.407493:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d44f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919374 expref: 35 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265558.407510:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:0.0:1789265558.407514:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265558.407518:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392e00, rc 0) 00000100:00100000:0.0:1789265558.407581:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+35:12235:x1876180556918528:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 207us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265558.407589:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 162 00000100:00100000:3.0:1789265558.414954:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265558.415199:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556918784 00000100:00100000:0.0:1789265558.415209:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556918784 00000100:00100000:0.0:1789265558.415277:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:0.0:1789265558.415288:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+35:12235:x1876180556918784:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:0.0:1789265558.415566:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+36:12235:x1876180556918784:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 279us (622us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789265558.415574:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:3.0:1789265558.515284:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180579015168:0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.515294:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180579015424:0@lo:400:kworker.0 00000100:00100000:2.0:1789265558.515377:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180579015040:0@lo:400:kworker.0 00000100:00100000:0.0:1789265558.515385:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579015296:0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.515541:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265558.515619:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579015936:0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.515650:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265558.515668:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579016448:0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.515687:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265558.515728:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579015936 00000100:00100000:1.0:1789265558.515734:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579015936 00000100:00100000:1.0:1789265558.515800:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579016448 00000100:00100000:1.0:1789265558.515803:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579016448 00000100:00100000:3.0:1789265558.515835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265558.515904:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764241b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180579015680:0@lo:400:kworker.0 00000100:00100000:3.0:1789265558.515929:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265558.515947:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180579016192:0@lo:400:kworker.0 00000100:00100000:3.0:1789265558.515971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265558.516004:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579015424 00000100:00100000:3.0:1789265558.516008:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579015424 00000100:00100000:3.0:1789265558.516039:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579015168 00000100:00100000:3.0:1789265558.516043:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579015168 00000100:00100000:3.0:1789265558.516061:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579015680 00000100:00100000:3.0:1789265558.516065:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579015680 00000100:00100000:1.0:1789265558.516071:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789265558.516084:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579015936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265558.516095:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579016192 00000100:00100000:3.0:1789265558.516099:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579016192 00000100:00100000:3.0:1789265558.516116:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789265558.516126:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180579015424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.516143:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579015936:12345-0@lo:400:kworker.0 Request processed in 60us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265558.516150:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789265558.516174:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789265558.516175:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180579015424:12345-0@lo:400:kworker.0 Request processed in 48us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265558.516183:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579016448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265558.516186:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789265558.516218:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789265558.516225:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579016448:12345-0@lo:400:kworker.0 Request processed in 43us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265558.516230:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180579015168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.516237:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1789265558.516272:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265558.516277:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265558.516280:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265558.516281:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265558.516312:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180579015424:0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.516325:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579015936:0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.516334:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579016448:0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.516364:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789265558.516379:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e6fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180579015680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.516418:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180579015680:12345-0@lo:400:kworker.0 Request processed in 40us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265558.516424:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789265558.516439:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789265558.516445:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180579016192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.516473:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180579016192:12345-0@lo:400:kworker.0 Request processed in 29us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265558.516479:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789265558.516505:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764241b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180579015680:0@lo:400:kworker.0 00010000:00080000:1.0:1789265558.516518:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937779e54380 x1876180579016192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265558.516529:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180579016192:0@lo:400:kworker.0 00000100:00100000:2.0:1789265558.520805:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265558.520899:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579015552:0@lo:400:kworker.0 00000100:00100000:2.0:1789265558.520936:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265558.520964:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180579016064:0@lo:400:kworker.0 00000100:00100000:2.0:1789265558.520989:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265558.521045:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579016064 00000100:00100000:2.0:1789265558.521052:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579016064 00000100:00100000:2.0:1789265558.521103:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789265558.521113:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180579016064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265558.521159:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180579016064:12345-0@lo:400:kworker.0 Request processed in 48us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265558.521166:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:2.0:1789265558.521185:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265558.521211:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180579016064:0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.521476:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579015040 00000100:00100000:1.0:1789265558.521481:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579015040 00000100:00100000:1.0:1789265558.521518:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789265558.521525:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180579015040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.521567:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180579015040:12345-0@lo:400:kworker.0 Request processed in 43us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265558.521574:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789265558.521623:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579015552 00000100:00100000:1.0:1789265558.521627:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579015552 00000100:00100000:1.0:1789265558.521648:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789265558.521655:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579015552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.521690:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579015552:12345-0@lo:400:kworker.0 Request processed in 36us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265558.521713:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789265558.522224:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180579015040:0@lo:400:kworker.0 00000100:00100000:2.0:1789265558.522237:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579015552:0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.524034:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180579015168:0@lo:400:kworker.0 00000100:00100000:2.0:1789265558.524128:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e6fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180579015168:12345-0@lo:400:kworker.0 Request processed in 7901us (8291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265558.524138:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789265558.525134:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265558.525184:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764241b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180579015808:0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.525216:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265558.525234:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937779e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579016320:0@lo:400:kworker.0 00000100:00100000:1.0:1789265558.525255:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265558.525349:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579015808 00000100:00100000:2.0:1789265558.525357:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579015808 00000100:00100000:2.0:1789265558.525411:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789265558.525431:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180579015808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265558.525471:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180579015808:12345-0@lo:400:kworker.0 Request processed in 41us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265558.525476:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:2.0:1789265558.525495:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265558.525595:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579015296 00010000:00080000:1.0:1789265558.525597:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93764241b800 x1876180579015808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265558.525601:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579015296 00000100:00100000:1.0:1789265558.525613:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764241b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180579015808:0@lo:400:kworker.0 00000100:00100000:0.0:1789265558.525650:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789265558.525660:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579015296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265558.525713:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579015296:12345-0@lo:400:kworker.0 Request processed in 56us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265558.525721:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579016320 00000100:00100000:0.0:1789265558.525722:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789265558.525727:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579016320 00000100:00100000:1.0:1789265558.525814:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579015296:0@lo:400:kworker.0 00000100:00100000:3.0:1789265558.525842:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789265558.525852:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579016320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265558.526086:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579016320:12345-0@lo:400:kworker.0 Request processed in 236us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265558.526093:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1789265558.530522:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265558.541408:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937779e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579016320:0@lo:400:kworker.0 00000100:00100000:3.0:1789265558.556753:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265558.556910:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556919040 00000100:00100000:2.0:1789265558.556921:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556919040 00000100:00100000:2.0:1789265558.557044:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 163 00000100:00100000:2.0:1789265558.557055:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+36:12245:x1876180556919040:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265558.557081:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265558.557102:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d44f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91937b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265558.557212:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789265558.557334:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d44f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91937b expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.557350:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d97a00) 00010000:00010000:2.0:1789265558.557353:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265558.557357:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d44f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91937b expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.557374:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd400, rc 0) 00000100:00100000:2.0:1789265558.557440:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+37:12245:x1876180556919040:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 387us (698us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1789265558.557448:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 163 00000100:00100000:3.0:1789265558.561715:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265558.569770:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556919168 00000100:00100000:1.0:1789265558.569786:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556919168 00000100:00100000:1.0:1789265558.570065:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 164 00000100:00100000:1.0:1789265558.570078:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+37:12245:x1876180556919168:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:3.0:1789265558.570197:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4505 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570215:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4505 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570227:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4505 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570239:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d450c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570258:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d450c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570265:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d450c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570343:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d4513 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570351:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d4513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570358:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d4513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265558.570406:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d4513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570419:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4505 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570425:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4505 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570433:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4505 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570440:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265558.570445:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4505 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570453:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4505 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570472:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:3.0:1789265558.570475:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265558.570480:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4505 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570486:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4505 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570502:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d450c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570509:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d450c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570515:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d450c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570520:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265558.570523:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d450c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570529:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d450c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570537:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575300) 00010000:00010000:3.0:1789265558.570540:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265558.570544:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d450c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570550:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d450c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570571:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d4513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570576:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d4513 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570582:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d4513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570587:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265558.570590:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d4513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570596:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d4513 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570605:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:3.0:1789265558.570607:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265558.570610:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d4513 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265558.570617:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d4513 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265558.570725:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+37:12245:x1876180556919168:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 647us (9030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265558.570734:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 164 00000100:00100000:3.0:1789265558.575187:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265558.575680:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556919424 00000100:00100000:0.0:1789265558.575755:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556919424 00000100:00100000:0.0:1789265558.575911:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:0.0:1789265558.575923:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+37:12245:x1876180556919424:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:0.0:1789265558.576167:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+38:12245:x1876180556919424:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 247us (991us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789265558.576175:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:2.0:1789265558.664750:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265558.664920:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556919680 00000100:00100000:1.0:1789265558.664931:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556919680 00000100:00100000:1.0:1789265558.665007:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 165 00000100:00100000:1.0:1789265558.665017:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+38:12248:x1876180556919680:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1789265558.665042:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265558.665066:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d451a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919382 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665160:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4521 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665175:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4521 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665186:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4521 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665196:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d4528 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665204:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d4528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665211:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d4528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665351:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d452f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665360:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d452f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665367:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d452f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265558.665376:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789265558.665453:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4521 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665471:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4521 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665477:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4521 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665483:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265558.665487:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4521 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665495:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4521 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665507:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:1.0:1789265558.665510:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265558.665515:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4521 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665521:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4521 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665534:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d4528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665540:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d4528 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665545:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d4528 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665550:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265558.665559:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d4528 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665566:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d4528 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665574:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575300) 00010000:00010000:1.0:1789265558.665577:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265558.665580:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d4528 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665586:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d4528 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665624:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d451a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919382 expref: 41 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665639:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d452f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919382 expref: 40 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265558.665645:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:1.0:1789265558.665647:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265558.665650:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bda00, rc 0) 00000100:00100000:1.0:1789265558.665722:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+40:12248:x1876180556919680:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 706us (995us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789265558.665730:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 165 00000100:00100000:1.0:1789265558.679344:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265558.681959:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556919808 00000100:00100000:2.0:1789265558.681974:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556919808 00000100:00100000:2.0:1789265558.682063:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 166 00000100:00100000:2.0:1789265558.682076:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+40:12248:x1876180556919808:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:2.0:1789265558.682159:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d453d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.682180:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d453d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.682194:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d453d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.682237:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d453d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.682244:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d453d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.682250:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d453d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.682256:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265558.682261:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d453d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.682269:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d453d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.682282:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:2.0:1789265558.682286:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265558.682308:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d453d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265558.682315:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d453d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265558.682415:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+40:12248:x1876180556919808:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 341us (3081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265558.682422:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 166 00000100:00100000:3.0:1789265558.686119:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265558.686223:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556920064 00000100:00100000:2.0:1789265558.686233:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556920064 00000100:00100000:2.0:1789265558.686282:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:2.0:1789265558.686292:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+40:12248:x1876180556920064:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1789265558.686533:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+41:12248:x1876180556920064:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 241us (423us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789265558.686541:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:1.0:1789265559.027730:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265559.027759:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764241b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579016576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265559.027851:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265559.027903:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579016576 00000100:00100000:3.0:1789265559.027918:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579016576 00000100:00100000:0.0:1789265559.028373:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265559.028386:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579016704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265559.028422:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265559.028524:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579016704 00000100:00100000:2.0:1789265559.028530:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579016704 00000100:00100000:2.0:1789265559.028593:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789265559.028604:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579016704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265559.028642:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789265559.028696:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579016704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265559.028703:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789265559.029018:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579016704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265559.030276:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789265559.030296:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579016576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265559.030318:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789265559.030395:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579016576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (2543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265559.030403:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789265559.031103:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764241b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579016576:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265559.091191:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265559.132347:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265559.132491:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556920320 00000100:00100000:2.0:1789265559.132503:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556920320 00000100:00080000:3.0:1789265559.132639:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265559.132687:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 167 00000100:00100000:2.0:1789265559.132699:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+41:12280:x1876180556920320:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:2.0:1789265559.132735:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265559.132823:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4544 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919389 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.133026:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d454b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.133042:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d454b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.133054:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d454b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265559.133066:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789265559.133174:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4544 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919389 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.133194:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d454b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919389 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.133202:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:2.0:1789265559.133204:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265559.133207:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc200, rc 0) 00000100:00100000:2.0:1789265559.133274:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+43:12280:x1876180556920320:12345-192.168.202.42@tcp:101:cat.0 Request processed in 577us (937us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789265559.133281:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 167 00000100:00100000:1.0:1789265559.139850:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265559.139939:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265559.140020:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556920704 00000100:00100000:2.0:1789265559.140030:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556920704 00000100:00100000:3.0:1789265559.140068:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556920448 00000100:00100000:3.0:1789265559.140073:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556920448 00000100:00100000:2.0:1789265559.140083:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:2.0:1789265559.140107:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+44:12280:x1876180556920704:12345-192.168.202.42@tcp:35:cat.0 00000100:00100000:3.0:1789265559.140124:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:3.0:1789265559.140131:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377583da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+44:2398:x1876180556920448:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265559.140145:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265559.140170:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d454b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919389 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.140187:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:3.0:1789265559.140191:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265559.140242:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377583da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+43:2398:x1876180556920448:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 112us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265559.140250:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:2.0:1789265559.140300:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+43:12280:x1876180556920704:12345-192.168.202.42@tcp:35:cat.0 Request processed in 195us (361us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789265559.140307:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:3.0:1789265559.225681:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265559.225796:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556920960 00000100:00100000:1.0:1789265559.225808:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556920960 00000100:00100000:1.0:1789265559.226078:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 168 00000100:00100000:1.0:1789265559.226091:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+43:12286:x1876180556920960:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:1.0:1789265559.226118:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265559.226121:0:14174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789265559.226149:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d44b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91935f expref: 43 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.226168:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:1.0:1789265559.226172:0:14174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265559.226186:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d4559 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919390 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.226450:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.226464:0:14174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d452f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919382 expref: 43 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.226473:0:14174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.226505:0:14174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d452f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919382 expref: 43 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.226531:0:14174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d452f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919382 expref: 43 pid: 14174 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265559.226545:0:14174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642419880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14174:1876180579016832:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265559.226660:0:14174:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265559.236213:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265559.236390:0:14174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642419880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14174:1876180579016832:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265559.236421:0:14174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265559.236590:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556921088 00000100:00100000:3.0:1789265559.236598:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556921088 00010000:00010000:3.0:1789265559.236636:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d452f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919382 expref: 44 pid: 14174 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265559.236680:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 85 00000100:00100000:3.0:1789265559.236705:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+44:2400:x1876180556921088:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265559.236721:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265559.236729:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d452f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919382 expref: 44 pid: 14174 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.236743:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d452f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919382 expref: 44 pid: 14174 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.236765:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d452f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919382 expref: 44 pid: 14174 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.236782:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:3.0:1789265559.236787:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.236797:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.236805:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.236824:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265559.236922:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+43:2400:x1876180556921088:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 219us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265559.236930:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 85 00010000:00010000:1.0:1789265559.238004:0:14174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.238017:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265559.238042:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789265559.238185:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d4559 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919390 expref: 44 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.238204:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919390 expref: 43 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.238214:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:1.0:1789265559.238231:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265559.238234:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc600, rc 0) 00000100:00100000:1.0:1789265559.238304:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+43:12286:x1876180556920960:12345-192.168.202.42@tcp:101:dd.0 Request processed in 12217us (12635us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1789265559.238324:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 168 00000100:00100000:0.0:1789265559.252212:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265559.253050:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556921216 00000100:00100000:2.0:1789265559.253063:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556921216 00000100:00100000:2.0:1789265559.253135:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 169 00000100:00100000:2.0:1789265559.253146:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+43:12286:x1876180556921216:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:2.0:1789265559.253171:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265559.253199:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d456e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919397 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.253237:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4575 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.253254:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.254175:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.255696:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d456e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919397 expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.255731:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4575 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919397 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.255743:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:2.0:1789265559.255764:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265559.255992:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd600, rc 0) 00000100:00100000:2.0:1789265559.256094:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+44:12286:x1876180556921216:12345-192.168.202.42@tcp:101:dd.0 Request processed in 2946us (3889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265559.256103:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 169 00000100:00100000:3.0:1789265559.260364:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265559.260476:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556921472 00000100:00100000:2.0:1789265559.260497:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556921472 00000100:00100000:2.0:1789265559.260564:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 170 00000100:00100000:2.0:1789265559.261000:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+44:12286:x1876180556921472:12345-192.168.202.42@tcp:36:dd.0 00010000:00010000:2.0:1789265559.261269:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d457c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.261289:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d457c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.261303:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d457c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265559.261352:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1789265559.261375:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085f994dd reply state 00000000a023f6fa transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d457c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.261388:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d457c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.261395:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:2.0:1789265559.261398:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265559.261402:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265559.261515:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+47:12286:x1876180556921472:12345-192.168.202.42@tcp:36:dd.0 Request processed in 521us (1160us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1789265559.268062:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 170 00000020:00080000:2.0:1789265559.268096:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789265559.310139:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265559.310250:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265559.310288:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265559.310341:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265559.310370:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556922112 00000100:00100000:3.0:1789265559.310380:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556922112 00000100:00100000:1.0:1789265559.310439:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556921856 00000100:00100000:3.0:1789265559.310440:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556921728 00000100:00100000:1.0:1789265559.310447:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556921856 00000100:00100000:3.0:1789265559.310448:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556921728 00000100:00100000:3.0:1789265559.310483:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 336 00000100:00100000:1.0:1789265559.310498:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 165 00000100:00100000:3.0:1789265559.310499:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556922112:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265559.310512:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556921856:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265559.310583:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556921856:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 75us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265559.310592:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 165 00000100:00100000:2.0:1789265559.310617:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 337 00000100:00100000:2.0:1789265559.310631:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556921728:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265559.312192:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556921600 00000100:00100000:0.0:1789265559.312203:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556921600 00000100:00100000:0.0:1789265559.312382:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 394 00000100:00100000:0.0:1789265559.312404:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:2399:x1876180556921600:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265559.313012:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556922112:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 2515us (2718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265559.313023:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 336 00000100:00080000:3.0:1789265559.313061:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265559.313068:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265559.316160:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265559.316231:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265559.316276:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556922240 00000100:00100000:3.0:1789265559.316281:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556921984 00000100:00100000:1.0:1789265559.316287:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556922240 00000100:00100000:3.0:1789265559.316288:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556921984 00000100:00100000:3.0:1789265559.316356:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 166 00000100:00100000:1.0:1789265559.316362:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 338 00000100:00100000:3.0:1789265559.316372:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2399:x1876180556921984:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265559.316377:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556922240:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265559.316450:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2399:x1876180556921984:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 83us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265559.316458:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 166 00000100:00080000:3.0:1789265559.316479:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265559.316483:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265559.318504:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556921728:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 7865us (8150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265559.318518:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 337 00000100:00100000:0.0:1789265559.320158:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:2399:x1876180556921600:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 7746us (10020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265559.320171:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 394 00000100:00100000:1.0:1789265559.325030:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556922240:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 8645us (8785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265559.325046:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 338 00000100:00100000:1.0:1789265559.585935:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265559.586014:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556922368 00000100:00100000:3.0:1789265559.586025:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556922368 00000100:00100000:3.0:1789265559.586087:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 171 00000100:00100000:3.0:1789265559.586097:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+47:12300:x1876180556922368:12345-192.168.202.42@tcp:101:stat.0 00010000:00010000:3.0:1789265559.586121:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265559.586141:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d4583 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91939e expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.586223:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d458a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.586237:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d458a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.586251:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d458a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.586262:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4591 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.586269:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.586275:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.586351:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4598 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.586363:0:9988:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919390 expref: 48 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.586371:0:9988:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4598 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.586402:0:9988:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919390 expref: 48 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.586425:0:9988:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919390 expref: 48 pid: 14174 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265559.586440:0:9988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f298000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9988:1876180579016960:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265559.586558:0:9988:0:(client.c:2715:ptlrpc_set_wait()) set ffff937756f0d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789265559.591475:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265559.591537:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556922624 00000100:00100000:2.0:1789265559.591547:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556922624 00000100:00100000:0.0:1789265559.591630:0:9988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f298000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9988:1876180579016960:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265559.591657:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 43 00010000:00010000:0.0:1789265559.591663:0:9988:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4598 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265559.591671:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+49:10785:x1876180556922624:12345-192.168.202.42@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789265559.592006:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+50:10785:x1876180556922624:12345-192.168.202.42@tcp:35:ldlm_bl.0 Request processed in 338us (539us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789265559.592014:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:1.0:1789265559.594224:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265559.594387:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556922752 00000100:00100000:3.0:1789265559.594474:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556922752 00010000:00010000:3.0:1789265559.594519:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919390 expref: 50 pid: 14174 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265559.594566:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 86 00000100:00100000:3.0:1789265559.594578:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+50:2400:x1876180556922752:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265559.594593:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265559.594600:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919390 expref: 50 pid: 14174 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.594615:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919390 expref: 50 pid: 14174 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.594651:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4560 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919390 expref: 50 pid: 14174 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.594668:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:3.0:1789265559.594673:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4598 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.594706:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4598 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.594713:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4598 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265559.594753:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265559.594813:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+49:2400:x1876180556922752:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 239us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265559.594819:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 86 00010000:00010000:0.0:1789265559.594901:0:9988:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4598 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.594912:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4598 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265559.594967:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789265559.594972:0:9988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265559.594999:0:9988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4598 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595014:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4598 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595024:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d458a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595032:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d458a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595039:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d458a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595055:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265559.595060:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d458a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595068:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d458a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595078:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:0.0:1789265559.595081:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265559.595085:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d458a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595090:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d458a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595104:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595110:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4591 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595116:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4591 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595121:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265559.595124:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4591 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595130:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4591 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595148:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575300) 00010000:00010000:0.0:1789265559.595151:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265559.595154:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4591 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595160:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d4591 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595193:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d4583 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91939e expref: 49 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595208:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4598 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91939e expref: 48 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265559.595217:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:0.0:1789265559.595219:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265559.595222:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a4200, rc 0) 00000100:00100000:0.0:1789265559.595251:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+48:12300:x1876180556922368:12345-192.168.202.42@tcp:101:stat.0 Request processed in 9156us (9397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265559.595259:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 171 00000100:00100000:1.0:1789265559.661404:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265559.661666:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556923008 00000100:00100000:2.0:1789265559.661678:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556923008 00000100:00100000:2.0:1789265559.661760:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 172 00000100:00100000:2.0:1789265559.661770:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+48:12306:x1876180556923008:12345-192.168.202.42@tcp:36:truncate.0 00010000:00010000:2.0:1789265559.661827:0:14174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265559.661899:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4598 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91939e expref: 48 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.661925:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:2.0:1789265559.661931:0:14174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265559.662139:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d459f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.662156:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d459f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.662182:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d459f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265559.662793:0:14174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1789265559.662820:0:14174:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acd66e77 reply state 00000000be9233db transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d459f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.662834:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d459f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265559.662841:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:2.0:1789265559.662844:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265559.662847:0:14174:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265559.663152:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+50:12306:x1876180556923008:12345-192.168.202.42@tcp:36:truncate.0 Request processed in 1381us (1756us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789265559.663162:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 172 00000020:00080000:2.0:1789265559.663169:0:14174:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789265559.892805:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265559.892902:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556923136 00000100:00100000:1.0:1789265559.892914:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556923136 00000100:00100000:1.0:1789265559.893038:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 173 00000100:00100000:1.0:1789265559.893049:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+50:12320:x1876180556923136:12345-192.168.202.42@tcp:101:stat.0 00010000:00010000:1.0:1789265559.893074:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265559.893109:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d45a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9193a5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893178:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d45ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893204:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d45ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893215:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d45ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893226:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d45b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893233:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d45b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893240:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d45b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893317:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d45bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893327:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d45bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893333:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d45bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265559.893377:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789265559.893382:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265559.893411:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d45bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893430:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d45bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893439:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d45ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893445:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d45ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893451:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d45ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893457:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265559.893461:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d45ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893469:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d45ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893481:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:1.0:1789265559.893485:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265559.893489:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d45ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893495:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d45ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893509:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d45b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893515:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d45b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893527:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d45b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893532:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265559.893535:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d45b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893542:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d45b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893551:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575300) 00010000:00010000:1.0:1789265559.893553:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265559.893556:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d45b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893561:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d45b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.893591:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d45a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193a5 expref: 52 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.894155:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d45bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193a5 expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265559.894165:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:1.0:1789265559.894167:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265559.894170:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd600, rc 0) 00000100:00100000:1.0:1789265559.894257:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+51:12320:x1876180556923136:12345-192.168.202.42@tcp:101:stat.0 Request processed in 1209us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265559.894275:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 173 00000100:00100000:1.0:1789265560.020448:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265560.020558:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556923392 00000100:00100000:0.0:1789265560.020579:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556923392 00000100:00100000:0.0:1789265560.020657:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 174 00000100:00100000:0.0:1789265560.020668:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+51:12330:x1876180556923392:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1789265560.020702:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265560.020724:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d45c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9193ac expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265560.020908:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789265560.021027:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d45c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193ac expref: 53 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265560.021042:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d97a00) 00010000:00010000:0.0:1789265560.021045:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265560.021050:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d45c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193ac expref: 53 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265560.021064:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393c00, rc 0) 00000100:00100000:0.0:1789265560.021137:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+52:12330:x1876180556923392:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 472us (699us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1789265560.021145:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 174 00000100:00100000:2.0:1789265560.028552:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265560.028905:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556923648 00000100:00100000:3.0:1789265560.028914:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556923648 00000100:00100000:3.0:1789265560.028972:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:3.0:1789265560.028983:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779d30850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+52:12330:x1876180556923648:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1789265560.029220:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779d30850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+53:12330:x1876180556923648:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 239us (676us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789265560.029228:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:1.0:1789265560.051305:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265560.051331:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579017088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265560.051419:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265560.051688:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579017088 00000100:00100000:2.0:1789265560.051696:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579017088 00000100:00100000:2.0:1789265560.051754:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789265560.051766:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775836bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579017088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265560.051802:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265560.051883:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775836bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579017088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265560.051890:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789265560.052489:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579017216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265560.052667:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265560.052776:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579017088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265560.052952:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579017216 00000100:00100000:2.0:1789265560.052975:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579017216 00000100:00100000:2.0:1789265560.053070:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789265560.053078:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579017216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265560.053113:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789265560.053172:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579017216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265560.053177:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789265560.053227:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579017216:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789265560.115170:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265560.128435:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265560.130404:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556923904 00000100:00100000:2.0:1789265560.130427:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556923904 00000100:00100000:2.0:1789265560.130537:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 175 00000100:00100000:2.0:1789265560.130552:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+53:12336:x1876180556923904:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1789265560.130589:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265560.130618:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d45d0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9193b3 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.130771:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.130790:0:14174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d45bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193a5 expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.130802:0:14174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.130855:0:14174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d45bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193a5 expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.130900:0:14174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d45bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193a5 expref: 54 pid: 6519 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265560.130951:0:14174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d11880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14174:1876180579017344:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265560.131088:0:14174:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e787240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265560.137348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265560.137940:0:14174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d11880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14174:1876180579017344:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265560.137988:0:14174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265560.138121:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556924032 00000100:00100000:3.0:1789265560.138131:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556924032 00010000:00010000:3.0:1789265560.138186:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d45bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193a5 expref: 55 pid: 6519 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265560.138236:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 87 00000100:00100000:3.0:1789265560.138247:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+55:2399:x1876180556924032:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265560.138267:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265560.138296:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d45bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193a5 expref: 55 pid: 6519 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.138310:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d45bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193a5 expref: 55 pid: 6519 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.138338:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d45bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193a5 expref: 55 pid: 6519 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.138359:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:3.0:1789265560.138365:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.138378:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.138388:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.138421:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265560.138818:0:14174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.138829:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265560.138892:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789265560.139146:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d45d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193b3 expref: 56 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265560.139156:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+55:2399:x1876180556924032:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 910us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265560.139165:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 87 00010000:00010000:2.0:1789265560.139167:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193b3 expref: 55 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.139175:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:2.0:1789265560.139177:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265560.139180:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fdc00, rc 0) 00000100:00100000:2.0:1789265560.139465:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+54:12336:x1876180556923904:12345-192.168.202.42@tcp:101:bash.0 Request processed in 8915us (11040us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789265560.139819:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 175 00000100:00100000:1.0:1789265560.147675:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265560.148220:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556924288 00000100:00100000:2.0:1789265560.148262:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556924288 00000100:00100000:2.0:1789265560.148353:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 176 00000100:00100000:2.0:1789265560.148367:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+54:12336:x1876180556924288:12345-192.168.202.42@tcp:36:bash.0 00010000:00010000:2.0:1789265560.148706:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d45e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.148744:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d45e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.148760:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d45e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265560.148818:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1789265560.148843:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd395e8c reply state 0000000074010efd transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d45e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.148902:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d45e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.148910:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:2.0:1789265560.148983:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265560.148988:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265560.149117:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+57:12336:x1876180556924288:12345-192.168.202.42@tcp:36:bash.0 Request processed in 751us (1459us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1789265560.149125:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 176 00000020:00080000:2.0:1789265560.149133:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789265560.162997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265560.163077:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556924416 00000100:00100000:2.0:1789265560.163093:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556924416 00000100:00100000:2.0:1789265560.163179:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 177 00000100:00100000:2.0:1789265560.163196:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+57:12336:x1876180556924416:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1789265560.163270:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265560.163305:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d45ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9193ba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.163439:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d45f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.163459:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193b3 expref: 58 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.163468:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d45f3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.163523:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193b3 expref: 58 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.163538:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193b3 expref: 58 pid: 14174 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265560.163552:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d11880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876180579017472:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265560.163680:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e787240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265560.175417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265560.176145:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d11880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876180579017472:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265560.176192:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d45f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265560.176297:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556924544 00000100:00100000:3.0:1789265560.176309:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556924544 00010000:00010000:3.0:1789265560.176362:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193b3 expref: 59 pid: 14174 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265560.176411:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 88 00000100:00100000:3.0:1789265560.176421:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+59:2400:x1876180556924544:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265560.176460:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265560.176478:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193b3 expref: 59 pid: 14174 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.176494:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193b3 expref: 59 pid: 14174 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.176522:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d45d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193b3 expref: 59 pid: 14174 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.176543:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:3.0:1789265560.176549:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d45f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.176561:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d45f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.176572:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d45f3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.176604:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265560.176683:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+58:2400:x1876180556924544:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 262us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265560.176692:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 88 00010000:00010000:2.0:1789265560.176895:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d45f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.176904:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d45f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265560.177006:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789265560.177013:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265560.177045:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d45f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.177091:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d45ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193ba expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.177113:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d45f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193ba expref: 57 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.177123:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:2.0:1789265560.177126:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265560.177129:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fde00, rc 0) 00000100:00100000:2.0:1789265560.177176:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+57:12336:x1876180556924416:12345-192.168.202.42@tcp:101:bash.0 Request processed in 13988us (14197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265560.177184:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 177 00000100:00100000:1.0:1789265560.181410:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265560.183025:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556924800 00000100:00100000:3.0:1789265560.183054:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556924800 00000100:00100000:3.0:1789265560.183159:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:3.0:1789265560.183173:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+57:12336:x1876180556924800:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:3.0:1789265560.183558:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+58:12336:x1876180556924800:12345-192.168.202.42@tcp:35:bash.0 Request processed in 386us (2161us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789265560.183567:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:3.0:1789265560.362710:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265560.363020:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556925056 00000100:00100000:2.0:1789265560.363036:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556925056 00000100:00100000:2.0:1789265560.363121:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 178 00000100:00100000:2.0:1789265560.363134:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+58:12346:x1876180556925056:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265560.363166:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265560.363192:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d45fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9193c1 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265560.363328:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789265560.363488:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d45fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193c1 expref: 60 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.363526:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d97a00) 00010000:00010000:2.0:1789265560.363529:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265560.363536:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d45fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193c1 expref: 60 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.363555:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc000, rc 0) 00000100:00100000:2.0:1789265560.363639:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+59:12346:x1876180556925056:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 508us (947us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1789265560.363647:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 178 00000001:00080000:0.0:1789265560.370154:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000004:00080000:0.0:1789265560.370215:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789265560.370240:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9377435d7840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789265560.370246:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93774f178a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9377435d7600 00000020:00080000:0.0:1789265560.370250:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93774f178c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff937643ca5200 00010000:00010000:1.0:1789265560.370841:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4433 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265560.371137:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265560.371169:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579017600:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789265560.371272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265560.371375:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579017600 00000100:00100000:3.0:1789265560.371385:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579017600 00000100:00100000:3.0:1789265560.371460:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789265560.371473:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876180579017600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789265560.371511:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1789265560.371562:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa60697, atime: 0x6aa60697, ctime: 0x6aa60697, blocks: 0x8 00010000:00010000:3.0:1789265560.371573:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4608 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.371596:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1789265560.371602:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265560.371610:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4608 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.371630:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4608 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.371640:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4608 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.371670:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4608 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.371692:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265560.371819:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4433 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.371827:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4433 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.371834:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265560.371841:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4433 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.371852:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4433 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789265560.372083:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789265560.372168:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1789265560.372371:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93774e575b00) 00010000:00010000:1.0:1789265560.372375:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265560.372382:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4433 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372389:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4433 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372416:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d443a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372423:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d443a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372429:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d443a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372434:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265560.372438:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d443a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372445:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d443a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372453:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:1.0:1789265560.372455:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265560.372459:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d443a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372465:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d443a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372494:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4479 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372501:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4479 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372508:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4479 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372513:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265560.372516:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4479 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372524:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4479 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372533:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575300) 00010000:00010000:1.0:1789265560.372535:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265560.372538:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4479 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372543:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4479 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372559:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d457c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372566:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d457c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372572:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d457c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372584:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265560.372587:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d457c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372594:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d457c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372603:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:1.0:1789265560.372605:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265560.372608:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d457c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372613:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d457c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372628:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d459f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372633:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d459f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372639:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d459f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372644:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265560.372646:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d459f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372652:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d459f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372670:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:1.0:1789265560.372672:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265560.372675:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d459f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372696:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d459f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372709:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d45e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.372715:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d45e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789265560.373275:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265560.374119:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265560.374135:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4608 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.374149:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5a00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:2.0:1789265560.374155:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4608 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.374166:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4608 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.374193:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4608 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.374226:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4608 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.374256:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265560.374259:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265560.374260:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265560.375109:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d45e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.375118:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265560.375123:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d45e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.375132:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d45e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.375148:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:1.0:1789265560.375151:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265560.375154:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d45e5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.375161:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d45e5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265560.377265:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1876180579017600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5778us (5976us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789265560.377286:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789265560.380567:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000004:00080000:1.0:1789265560.380831:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93777f464700/2, rc 0, transno 4294967308 00000100:00100000:1.0:1789265560.380880:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579017600:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789265560.381261:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556925184 00000100:00100000:2.0:1789265560.381273:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556925184 00000100:00100000:2.0:1789265560.381337:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 179 00000100:00100000:2.0:1789265560.381349:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+17:12346:x1876180556925184:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:2.0:1789265560.381450:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d460f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381474:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d460f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381489:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d460f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381511:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4616 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381519:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381525:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381631:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d461d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381661:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d461d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381670:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d461d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265560.381757:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d461d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381775:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d460f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381782:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d460f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381790:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d460f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381797:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265560.381802:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d460f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381812:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d460f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381825:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:2.0:1789265560.381829:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265560.381834:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d460f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.381841:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d460f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.382552:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.382558:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4616 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.382564:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4616 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.382569:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265560.382572:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4616 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.382579:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4616 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.382589:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff937777820600) 00010000:00010000:2.0:1789265560.382592:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265560.382595:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4616 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.382600:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4616 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.382619:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d461d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.382624:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d461d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.382630:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d461d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.382644:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fdc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265560.382648:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d461d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.382654:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d461d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.382662:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:2.0:1789265560.382664:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265560.382668:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d461d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.382673:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d461d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265560.382814:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+17:12346:x1876180556925184:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 1462us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265560.382825:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 179 00000100:00100000:3.0:1789265560.394431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265560.394573:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556925440 00000100:00100000:0.0:1789265560.394588:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556925440 00000100:00100000:0.0:1789265560.394669:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:0.0:1789265560.394692:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+17:12346:x1876180556925440:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:0.0:1789265560.395416:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+18:12346:x1876180556925440:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 734us (998us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789265560.395443:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:1.0:1789265560.462620:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265560.462954:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556925696 00000100:00100000:2.0:1789265560.462968:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556925696 00000100:00100000:2.0:1789265560.463050:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 180 00000100:00100000:2.0:1789265560.463072:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+18:12349:x1876180556925696:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265560.463104:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265560.463133:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4624 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9193c8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463242:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d462b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463281:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d462b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463296:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d462b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463313:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4632 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463321:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463327:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463453:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4639 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463462:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4639 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463469:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4639 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265560.463480:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789265560.463580:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d462b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463588:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d462b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463596:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d462b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463609:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265560.463614:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d462b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463623:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d462b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463639:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:2.0:1789265560.463642:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265560.463647:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d462b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463654:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d462b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463686:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463693:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4632 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463700:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4632 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463705:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265560.463708:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4632 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463714:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4632 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463738:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff937777820600) 00010000:00010000:2.0:1789265560.463740:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265560.463743:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4632 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463750:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d4632 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463803:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4624 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193c8 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463816:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4639 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193c8 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265560.463823:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:2.0:1789265560.463825:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265560.463828:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc400, rc 0) 00000100:00100000:2.0:1789265560.464001:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+20:12349:x1876180556925696:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 930us (1398us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789265560.464010:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 180 00000100:00100000:3.0:1789265560.475253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265560.475301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265560.475591:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556925824 00000100:00100000:0.0:1789265560.475606:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556925824 00000100:00100000:0.0:1789265560.475694:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 181 00000100:00100000:0.0:1789265560.475707:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+20:12349:x1876180556925824:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:0.0:1789265560.475813:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4647 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265560.475836:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4647 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265560.475852:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4647 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265560.476054:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4647 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265560.476063:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4647 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265560.476071:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4647 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265560.476078:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265560.476084:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4647 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265560.476094:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4647 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265560.476109:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:0.0:1789265560.476130:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265560.476137:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4647 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265560.476144:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d4647 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265560.476255:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+20:12349:x1876180556925824:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 549us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265560.476264:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 181 00000100:00100000:1.0:1789265560.476364:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556925952 00000100:00100000:1.0:1789265560.476371:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556925952 00000100:00100000:1.0:1789265560.476428:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:1.0:1789265560.476437:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+20:2398:x1876180556925952:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265560.476450:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265560.476469:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4639 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193c8 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.476484:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:1.0:1789265560.476488:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265560.476511:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+19:2398:x1876180556925952:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 75us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265560.476517:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:3.0:1789265560.485645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265560.492363:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556926208 00000100:00100000:2.0:1789265560.492388:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556926208 00000100:00100000:2.0:1789265560.492493:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:2.0:1789265560.492507:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+19:12349:x1876180556926208:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1789265560.493197:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+20:12349:x1876180556926208:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 688us (7563us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789265560.493207:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:0.0:1789265560.563531:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265560.563566:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764354d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579017728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265560.563674:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265560.564136:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579017728 00000100:00100000:1.0:1789265560.564152:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579017728 00000100:00100000:1.0:1789265560.564242:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789265560.564262:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876180579017728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265560.564304:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789265560.564376:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876180579017728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265560.564385:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789265560.567178:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764354d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579017728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265560.567544:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764354c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579017856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265560.567639:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265560.571087:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579017856 00000100:00100000:1.0:1789265560.571137:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579017856 00000100:00100000:1.0:1789265560.571242:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789265560.571255:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579017856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265560.571294:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789265560.571422:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579017856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 170us (3783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265560.571430:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789265560.571641:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764354c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579017856:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789265560.572017:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265560.686157:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265560.686320:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556926464 00000100:00100000:1.0:1789265560.686336:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556926464 00000100:00100000:1.0:1789265560.686430:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 182 00000100:00100000:1.0:1789265560.686443:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+20:12367:x1876180556926464:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:1.0:1789265560.686479:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265560.686508:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d464e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9193cf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.686650:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4655 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.686668:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4655 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.686682:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4655 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265560.686696:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789265560.687987:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d464e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193cf expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.688033:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4655 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193cf expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.688065:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:1.0:1789265560.688068:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789265560.688073:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bda00, rc 0) 00000100:00100000:1.0:1789265560.688164:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+22:12367:x1876180556926464:12345-192.168.202.42@tcp:101:cat.0 Request processed in 1722us (2021us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1789265560.688172:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 182 00000100:00100000:1.0:1789265560.727670:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265560.728070:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556926592 00000100:00100000:3.0:1789265560.728086:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556926592 00000100:00100000:3.0:1789265560.728177:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 183 00000100:00100000:3.0:1789265560.728191:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+22:12368:x1876180556926592:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265560.728228:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265560.728257:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4663 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9193d6 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.728372:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4a00/0xbbfdc9019c1d466a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.728391:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4a00/0xbbfdc9019c1d466a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.728430:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4a00/0xbbfdc9019c1d466a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265560.728492:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789265560.728497:0:14174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265560.728530:0:14174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4a00/0xbbfdc9019c1d466a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.728569:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4663 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193d6 expref: 24 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.728595:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4a00/0xbbfdc9019c1d466a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193d6 expref: 23 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.728605:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:3.0:1789265560.728609:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265560.728612:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a4a00, rc 0) 00000100:00100000:3.0:1789265560.728699:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+23:12368:x1876180556926592:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 511us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265560.728707:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 183 00000100:00100000:3.0:1789265560.737170:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265560.737376:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556926976 00000100:00100000:1.0:1789265560.737393:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556926976 00000100:00100000:1.0:1789265560.737482:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:1.0:1789265560.737495:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+23:12368:x1876180556926976:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:1.0:1789265560.738003:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+24:12368:x1876180556926976:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 510us (852us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789265560.738012:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:2.0:1789265560.743021:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265560.743338:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556927104 00000100:00100000:3.0:1789265560.743352:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556927104 00000100:00100000:3.0:1789265560.743606:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:3.0:1789265560.743622:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+24:12368:x1876180556927104:12345-192.168.202.42@tcp:103:lfs.0 00010000:00010000:3.0:1789265560.743646:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789265560.743692:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d45f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193ba expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.743748:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4655 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193cf expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.744020:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d44f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919374 expref: 22 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.744036:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:3.0:1789265560.744044:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265560.744399:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+21:12368:x1876180556927104:12345-192.168.202.42@tcp:103:lfs.0 Request processed in 780us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265560.744410:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:3.0:1789265560.759334:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265560.759723:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556927232 00000100:00100000:0.0:1789265560.759738:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556927232 00000100:00100000:0.0:1789265560.759822:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 184 00000100:00100000:0.0:1789265560.759835:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+21:12368:x1876180556927232:12345-192.168.202.42@tcp:58:lfs.0 00010000:00010000:0.0:1789265560.760059:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4671 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265560.760084:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4671 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265560.760099:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4671 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265560.760232:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789265560.760346:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+21:12368:x1876180556927232:12345-192.168.202.42@tcp:58:lfs.0 Request processed in 512us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265560.760363:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 184 00000100:00100000:0.0:1789265560.811671:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265560.818714:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556927360 00000100:00100000:1.0:1789265560.818738:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556927360 00000100:00100000:1.0:1789265560.819155:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 185 00000100:00100000:1.0:1789265560.819173:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+21:12370:x1876180556927360:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1789265560.819205:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265560.819234:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d4678 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9193dd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.819338:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d467f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.819378:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d467f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.819600:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d467f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.819623:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4686 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.819631:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.819639:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.819739:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d468d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.819750:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d468d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.819758:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d468d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265560.819815:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789265560.819821:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265560.820580:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d468d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820600:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d468d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820630:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d467f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820637:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d467f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820644:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d467f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820650:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265560.820655:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d467f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820663:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d467f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820679:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:1.0:1789265560.820682:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265560.820687:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d467f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820694:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d467f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820711:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820718:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4686 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820725:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4686 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820737:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265560.820740:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4686 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820747:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4686 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820756:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774f2ef400) 00010000:00010000:1.0:1789265560.820759:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265560.820762:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4686 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820768:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4686 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820817:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d4678 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193dd expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.820833:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d468d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193dd expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.823987:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:1.0:1789265560.824005:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265560.824014:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd600, rc 0) 00000100:00100000:1.0:1789265560.824149:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+22:12370:x1876180556927360:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 4973us (12484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265560.824161:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 185 00000040:00080000:0.0:1789265560.947109:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789265560.947123:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265560.947150:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789265560.947161:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265560.947342:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d72d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1876180579017984:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265560.947714:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775235aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265560.960005:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d72d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1876180579017984:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789265560.964170:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265560.967324:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556927488 00000100:00100000:0.0:1789265560.967338:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556927488 00000100:00100000:0.0:1789265560.967560:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 186 00000100:00100000:0.0:1789265560.967572:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+22:12381:x1876180556927488:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789265560.967604:0:9988:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789265560.967794:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+22:12381:x1876180556927488:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 224us (3632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265560.967803:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 186 00000100:00100000:0.0:1789265560.978702:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265560.978915:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556927616 00000100:00100000:3.0:1789265560.978924:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556927616 00000100:00100000:3.0:1789265560.979025:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 187 00000100:00100000:3.0:1789265560.979037:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+22:12381:x1876180556927616:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789265560.979117:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4694 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979133:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4694 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979147:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4694 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979346:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d469b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979419:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d469b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979427:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d469b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979460:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d46a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979714:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d46a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979723:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d46a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265560.979773:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789265560.979778:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265560.979792:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d46a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979804:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4694 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979809:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4694 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979816:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4694 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979832:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265560.979837:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4694 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979844:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4694 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979887:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93774712f300) 00010000:00010000:3.0:1789265560.979890:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265560.979894:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4694 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979901:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4694 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979914:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d469b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979919:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d469b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979924:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d469b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979930:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5a00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265560.979932:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d469b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979938:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d469b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979955:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff93774e575c00) 00010000:00010000:3.0:1789265560.979957:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265560.979960:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d469b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979966:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d469b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979981:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d46a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979986:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d46a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979992:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d46a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.979997:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265560.979999:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d46a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.980005:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d46a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.980012:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:3.0:1789265560.980013:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265560.980016:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d46a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265560.980021:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d46a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265560.980120:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+22:12381:x1876180556927616:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 Request processed in 1082us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265560.980129:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 187 00000100:00100000:3.0:1789265560.985389:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265560.985562:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556927872 00000100:00100000:1.0:1789265560.985586:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556927872 00000100:00100000:1.0:1789265560.985655:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 188 00000100:00100000:1.0:1789265560.985665:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+22:12381:x1876180556927872:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265560.985686:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265560.985707:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d46a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9193e4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.985815:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.985830:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.985842:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265560.985946:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789265560.986023:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.986032:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.986039:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.986045:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265560.986049:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.986056:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.986076:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:1.0:1789265560.986079:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265560.986084:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.986090:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.986132:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d46a9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193e4 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.986143:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93774712f300) 00010000:00010000:1.0:1789265560.986145:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265560.986149:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d46a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193e4 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265560.986157:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd400, rc 0) 00000100:00100000:1.0:1789265560.986223:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+23:12381:x1876180556927872:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 560us (845us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1789265560.986231:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 188 00000100:00100000:1.0:1789265561.008968:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265561.009194:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556928000 00000100:00100000:0.0:1789265561.009214:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556928000 00000100:00080000:3.0:1789265561.009279:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265561.009300:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 189 00000100:00100000:0.0:1789265561.009313:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+23:12381:x1876180556928000:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789265561.009356:0:9988:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789265561.009490:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+23:12381:x1876180556928000:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 179us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265561.009497:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 189 00000100:00100000:3.0:1789265561.016922:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265561.017022:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556928256 00000100:00100000:1.0:1789265561.017033:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556928256 00000100:00100000:1.0:1789265561.017092:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 190 00000100:00100000:1.0:1789265561.017102:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+23:12381:x1876180556928256:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265561.017122:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265561.017126:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789265561.017163:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4a00/0xbbfdc9019c1d466a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193d6 expref: 23 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.017194:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:1.0:1789265561.017199:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265561.017213:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d46be lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9193eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789265561.017676:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789265561.017828:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.017841:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.017892:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.017948:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d46be lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193eb expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.017963:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193eb expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.017971:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93774f2ef400) 00010000:00010000:1.0:1789265561.017974:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265561.017976:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd800, rc 0) 00000100:00100000:1.0:1789265561.018046:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+24:12381:x1876180556928256:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 945us (1134us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789265561.018061:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 190 00000100:00100000:2.0:1789265561.030659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265561.031292:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556928512 00000100:00100000:1.0:1789265561.031304:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556928512 00000100:00100000:1.0:1789265561.031367:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 191 00000100:00100000:1.0:1789265561.031378:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+24:12381:x1876180556928512:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789265561.031436:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265561.031475:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193eb expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.031494:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93774f2ef400) 00010000:00010000:1.0:1789265561.031506:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265561.031561:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d46d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031576:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d46d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031586:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d46d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031642:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d46da lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x84434a8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031650:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d46da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x84434a8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031657:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d46da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x84434a8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031707:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d46d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031714:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d46d3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031721:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d46d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031726:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265561.031730:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d46d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031737:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d46d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031760:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:0.0:1789265561.031763:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265561.031766:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d46d3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031772:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392600/0xbbfdc9019c1d46d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031782:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d46da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x84434a8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031788:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d46da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x84434a8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031794:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d46da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x84434a8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031799:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392e00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265561.031802:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d46da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x84434a8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031808:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d46da lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x84434a8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031815:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x84434a8f (ffff937779d97500) 00010000:00010000:0.0:1789265561.031817:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265561.031820:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d46da lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x84434a8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.031826:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392e00/0xbbfdc9019c1d46da lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x84434a8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265561.031963:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+23:12381:x1876180556928512:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 586us (1311us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265561.031970:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 191 00000100:00100000:3.0:1789265561.037957:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265561.038052:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556928640 00000100:00100000:0.0:1789265561.038066:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556928640 00000100:00100000:0.0:1789265561.038132:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 192 00000100:00100000:0.0:1789265561.038142:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+23:12381:x1876180556928640:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265561.038165:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265561.038194:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d46e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9193f2 expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.038231:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d46e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.038243:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d46e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.038254:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d46e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.038376:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d46e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f2 expref: 25 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.038395:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d46e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f2 expref: 24 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.038404:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff937779d97000) 00010000:00010000:0.0:1789265561.038413:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789265561.038417:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643218200, rc 0) 00000100:00100000:0.0:1789265561.038484:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+24:12381:x1876180556928640:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 343us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265561.038491:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 192 00000100:00100000:1.0:1789265561.048357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265561.049047:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556928896 00000100:00100000:3.0:1789265561.049059:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556928896 00000100:00100000:3.0:1789265561.049119:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 193 00000100:00100000:3.0:1789265561.049130:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+24:12381:x1876180556928896:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265561.049216:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d46ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.049234:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d46ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.049247:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d46ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265561.049424:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1789265561.049434:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 416710573743ns, next at 417710571343ns, rc = 0 00000004:00010000:3.0:1789265561.049485:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006733e930 reply state 00000000bdc12208 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d46ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.049499:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d46ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.049524:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff937779d97000) 00010000:00010000:3.0:1789265561.049526:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789265561.049530:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265561.050928:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+26:12381:x1876180556928896:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 1793us (2574us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789265561.050938:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 193 00000100:00100000:3.0:1789265561.056980:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265561.057152:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556929024 00000100:00100000:0.0:1789265561.057166:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556929024 00000100:00100000:0.0:1789265561.057236:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 194 00000100:00100000:0.0:1789265561.057249:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+26:12381:x1876180556929024:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265561.057282:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265561.057306:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d46f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9193f9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.057374:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d46f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f9 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.057389:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d46f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f9 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.057409:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff937779d97000) 00010000:00010000:0.0:1789265561.057412:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265561.057416:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643219a00, rc 0) 00000100:00100000:0.0:1789265561.057476:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+27:12381:x1876180556929024:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 230us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265561.057483:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 194 00000100:00100000:3.0:1789265561.078972:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265561.080309:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556929152 00000100:00100000:1.0:1789265561.080321:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556929152 00000100:00100000:1.0:1789265561.080387:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:1.0:1789265561.080396:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377812af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+6:2399:x1876180556929152:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789265561.080587:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265561.080638:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377812af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556929152:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 242us (1676us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789265561.080646:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:1.0:1789265561.083425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265561.085530:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556929408 00000100:00100000:0.0:1789265561.085542:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556929408 00000100:00100000:0.0:1789265561.085616:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:0.0:1789265561.085627:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+27:12381:x1876180556929408:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789265561.085898:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+28:12381:x1876180556929408:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 273us (2481us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1789265561.085907:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:3.0:1789265561.094302:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265561.094380:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556929664 00000100:00100000:1.0:1789265561.094391:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556929664 00000100:00100000:1.0:1789265561.094451:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 195 00000100:00100000:1.0:1789265561.094461:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+28:12381:x1876180556929664:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789265561.094648:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+28:12381:x1876180556929664:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 188us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265561.094671:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 195 00000100:00100000:0.0:1789265561.102806:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265561.102991:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556929792 00000100:00100000:1.0:1789265561.103002:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556929792 00000100:00100000:1.0:1789265561.103051:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 196 00000100:00100000:1.0:1789265561.103061:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+28:12381:x1876180556929792:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265561.103080:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265561.103102:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919400 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.103184:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4704 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.103198:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.103209:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265561.103255:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265561.103274:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.103300:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d46fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919400 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.103318:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4704 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919400 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.103327:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff937779d97000) 00010000:00010000:1.0:1789265561.103335:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789265561.103340:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc600, rc 0) 00000100:00100000:1.0:1789265561.103409:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+29:12381:x1876180556929792:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 349us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265561.103416:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 196 00000100:00100000:0.0:1789265561.107777:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265561.107897:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556929920 00000100:00100000:2.0:1789265561.107908:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556929920 00000100:00100000:2.0:1789265561.107972:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:2.0:1789265561.107983:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556929920:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265561.108005:0:9789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265561.108029:0:9789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b42104b/0xbbfdc9019c1d470b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919407 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265561.108057:0:9789:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa6069a, blocks: 0x0 00010000:00010000:2.0:1789265561.108078:0:9789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=416s v=(0 0) 00010000:00010000:2.0:1789265561.108082:0:9789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265561.108093:0:9789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b42104b/0xbbfdc9019c1d470b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919407 expref: 8 pid: 9789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.108115:0:9789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b42104b/0xbbfdc9019c1d470b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919407 expref: 8 pid: 9789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.108128:0:9789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc200, rc 0) 00000100:00100000:2.0:1789265561.108187:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2399:x1876180556929920:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 206us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265561.108195:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:2.0:1789265561.134406:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265561.134544:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556930176 00000100:00100000:3.0:1789265561.134555:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556930176 00000100:00100000:3.0:1789265561.134630:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 197 00000100:00100000:3.0:1789265561.134640:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+29:12381:x1876180556930176:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789265561.134760:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+29:12381:x1876180556930176:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 120us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265561.134768:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 197 00000100:00100000:3.0:1789265561.141652:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265561.141739:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556930304 00000100:00100000:1.0:1789265561.141751:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556930304 00000100:00100000:1.0:1789265561.141810:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:1.0:1789265561.141821:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+8:12381:x1876180556930304:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265561.141840:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265561.141979:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4712 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91940e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.142012:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b42104b/0xbbfdc9019c1d470b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919407 expref: 9 pid: 9789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.142022:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265561.142027:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265561.142033:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4712 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91940e expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.142068:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b42104b/0xbbfdc9019c1d470b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919407 expref: 9 pid: 9789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.142082:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b42104b/0xbbfdc9019c1d470b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919407 expref: 9 pid: 9789 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265561.142119:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1876180579018112:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265561.142216:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377600426c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789265561.142705:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265561.145763:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265561.145942:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556930432 00000100:00100000:2.0:1789265561.145952:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556930432 00010000:00010000:2.0:1789265561.145992:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b42104b/0xbbfdc9019c1d470b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919407 expref: 10 pid: 9789 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265561.146037:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 89 00000100:00100000:2.0:1789265561.146048:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377583db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+10:2398:x1876180556930432:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265561.146064:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265561.146088:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b42104b/0xbbfdc9019c1d470b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919407 expref: 10 pid: 9789 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.146103:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b42104b/0xbbfdc9019c1d470b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919407 expref: 10 pid: 9789 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.146128:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265561.146133:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265561.146140:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4712 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91940e expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.146150:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4712 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91940e expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.146190:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4712 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91940e expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265561.146205:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d11500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1876180579018240:192.168.202.42@tcp:105: 00000100:00100000:2.0:1789265561.146306:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7879c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789265561.146423:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b42104b/0xbbfdc9019c1d470b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919407 expref: 10 pid: 9789 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265561.146440:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1876180579018112:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265561.146467:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4712 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91940e expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.146479:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bcc00, rc 0) 00000100:00100000:1.0:1789265561.146527:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+9:12381:x1876180556930304:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 4708us (4887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265561.146534:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:2.0:1789265561.160497:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d11500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1876180579018240:192.168.202.42@tcp:105: 00010000:00010000:2.0:1789265561.160524:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265561.160595:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377583db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2398:x1876180556930432:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 14549us (14841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265561.160615:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 89 00000100:00100000:3.0:1789265561.163597:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265561.163929:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556930560 00000100:00100000:0.0:1789265561.163944:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556930560 00002000:00100000:0.0:1789265561.164024:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9377507a1180 x1876180556930560/t0(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:132/0 lens 504/0 e 0 to 0 dl 1789265572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265561.164053:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9377507a1180 with x1876180556930560 ext(0->8) 00002000:00010000:0.0:1789265561.164061:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9377507a1180 00000100:00100000:0.0:1789265561.164095:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:0.0:1789265561.164108:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2399:x1876180556930560:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789265561.165318:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+10:2399:x1876180556930560:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 Request processed in 1203us (1727us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789265561.165333:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00002000:00100000:0.0:1789265561.165344:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9377507a1180 x1876180556930560/t4294967315(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:132/0 lens 504/448 e 0 to 0 dl 1789265572 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789265561.165357:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9377507a1180 with x1876180556930560 ext(0->8) 00002000:00010000:0.0:1789265561.165363:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9377507a1180 00000100:00100000:3.0:1789265561.173354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265561.173522:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556930688 00000100:00100000:1.0:1789265561.173533:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556930688 00000100:00100000:1.0:1789265561.173600:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 198 00000100:00100000:1.0:1789265561.173612:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+29:12381:x1876180556930688:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789265561.188615:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1789265561.188639:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789265561.188729:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1789265561.188937:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1789265561.188964:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:3.0:1789265561.189063:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d46ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.189075:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d46ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.189083:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d46ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.189106:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265561.189114:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d46ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.189123:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d46ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.189144:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff937779d97000) 00010000:00010000:3.0:1789265561.189149:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789265561.189155:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d46ef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.189163:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d46ef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265561.189238:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579018368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789265561.189334:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265561.189700:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579018368 00000100:00100000:2.0:1789265561.189710:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579018368 00000100:00100000:2.0:1789265561.189808:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789265561.189825:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579018368:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1789265561.190011:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1789265561.190262:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789265561.190266:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789265562 00002000:00010000:2.0:1789265561.190269:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789265561.190272:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789265562 -> 1789265562 00002000:00010000:2.0:1789265561.190275:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789265561.190374:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180579018368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 555us (1046us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789265561.190382:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:3.0:1789265561.196697:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff937643d10a80/2, rc 0, transno 4294967316 00000100:00100000:3.0:1789265561.196716:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579018368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789265561.208112:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+19:12381:x1876180556930688:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 Request processed in 34479us (34747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265561.208132:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 198 00000100:00100000:2.0:1789265561.219229:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265561.219399:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556930816 00000100:00100000:3.0:1789265561.219410:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556930816 00000100:00100000:3.0:1789265561.219582:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:3.0:1789265561.219594:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+10:2400:x1876180556930816:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789265561.221271:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1789265561.221284:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1789265561.222140:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2400:x1876180556930816:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 Request processed in 2542us (2914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265561.222157:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:3.0:1789265561.226896:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265561.227015:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556931072 00000100:00100000:0.0:1789265561.227113:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556931072 00000100:00100000:1.0:1789265561.229041:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 199 00000100:00100000:1.0:1789265561.229063:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+19:12381:x1876180556931072:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789265561.229143:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265561.229172:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4704 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919400 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.229294:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff937779d97000) 00010000:00010000:1.0:1789265561.229298:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265561.229334:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4719 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.229351:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.229361:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265561.229738:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004ff19d2 reply state 00000000b78276fb transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.229754:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4719 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.229761:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff937779d97000) 00010000:00010000:1.0:1789265561.229764:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265561.229771:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265561.233903:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+20:12381:x1876180556931072:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 4838us (7056us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1789265561.233916:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 199 00000100:00100000:0.0:1789265561.247268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265561.247348:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556931200 00000100:00100000:2.0:1789265561.247383:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556931200 00000100:00100000:2.0:1789265561.247457:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:3.0:1789265561.248366:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556931200:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789265561.249001:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789265561.249008:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789265562 -> 1789265561 00002000:00010000:3.0:1789265561.249013:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789265559 00002000:00010000:3.0:1789265561.249016:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789265562 -> 1789265561 00002000:00010000:3.0:1789265561.249019:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789265561.249112:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2399:x1876180556931200:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 824us (1862us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789265561.249122:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:2.0:1789265561.262837:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265561.263140:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556931456 00000100:00100000:3.0:1789265561.263150:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556931456 00000100:00100000:3.0:1789265561.263314:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 200 00000100:00100000:3.0:1789265561.263325:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+20:12381:x1876180556931456:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789265561.263402:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.263420:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d46e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f2 expref: 20 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.263429:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.263478:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d46e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f2 expref: 20 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.263492:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d46e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f2 expref: 20 pid: 9988 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265561.263531:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937747f08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579018496:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265561.263644:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265561.271788:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265561.271907:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556931584 00000100:00100000:1.0:1789265561.271917:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556931584 00010000:00010000:1.0:1789265561.271960:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d46e8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f2 expref: 21 pid: 9988 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265561.272022:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 90 00000100:00100000:1.0:1789265561.272034:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+21:2400:x1876180556931584:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265561.272050:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265561.272059:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d46e8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f2 expref: 21 pid: 9988 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.272074:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d46e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f2 expref: 21 pid: 9988 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.272096:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff937779d97000) 00010000:00010000:1.0:1789265561.272102:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.272113:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.272121:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.272141:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265561.272208:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+21:2400:x1876180556931584:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 177us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265561.272221:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 90 00010000:00010000:3.0:1789265561.273428:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d46e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f2 expref: 20 pid: 9988 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265561.273453:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937747f08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579018496:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265561.276001:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.276324:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.276335:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.276377:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.276385:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.276392:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.276397:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265561.276401:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.276407:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.276425:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff937779d97000) 00010000:00010000:2.0:1789265561.276428:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789265561.276433:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.276439:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5000/0xbbfdc9019c1d4720 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265561.276751:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+19:12381:x1876180556931456:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 Request processed in 13422us (13919us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789265561.276762:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 200 00000100:00100000:2.0:1789265561.279824:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265561.279953:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556931712 00000100:00100000:1.0:1789265561.279964:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556931712 00000100:00100000:1.0:1789265561.280021:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:1.0:1789265561.280032:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2399:x1876180556931712:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789265561.280097:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4727 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.280119:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91940e expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.280128:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265561.280133:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265561.280137:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4727 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.280173:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4712 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91940e expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.280201:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4712 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91940e expref: 8 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265561.280217:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1876180579018624:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265561.280307:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265561.287275:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265561.287357:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556931840 00000100:00100000:0.0:1789265561.287376:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556931840 00010000:00010000:0.0:1789265561.287437:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4712 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91940e expref: 9 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265561.287541:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 91 00000100:00100000:0.0:1789265561.287553:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2399:x1876180556931840:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265561.287577:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265561.287606:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4712 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91940e expref: 9 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.287622:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4712 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91940e expref: 9 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.287660:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265561.287666:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265561.287674:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4727 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.287686:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4727 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.287714:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265561.287789:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2399:x1876180556931840:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 237us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265561.287815:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 91 00010000:00010000:1.0:1789265561.289115:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4712 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91940e expref: 8 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265561.289139:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1876180579018624:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265561.289172:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4727 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.289199:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4727 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.289208:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4727 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.289245:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4727 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.289256:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4727 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.289266:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4727 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.289274:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265561.289280:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4727 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.289290:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4727 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.289312:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4727 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.289334:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4a11549/0xbbfdc9019c1d4727 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265561.289438:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556931712:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 Request processed in 9407us (9623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265561.289449:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:3.0:1789265561.292974:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265561.293086:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556932096 00000100:00100000:1.0:1789265561.293098:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556932096 00000100:00100000:1.0:1789265561.293163:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 201 00000100:00100000:1.0:1789265561.293175:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+19:12381:x1876180556932096:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789265561.293289:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.293308:0:14174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4575 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919397 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.293318:0:14174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.293360:0:14174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4575 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919397 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.293374:0:14174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4575 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919397 expref: 19 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265561.293390:0:14174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14174:1876180579018752:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265561.293546:0:14174:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265561.299413:0:14174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14174:1876180579018752:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265561.299563:0:14174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265561.303602:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265561.304395:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556932224 00000100:00100000:0.0:1789265561.304415:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556932224 00010000:00010000:0.0:1789265561.304495:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4575 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919397 expref: 20 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265561.304539:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 92 00000100:00100000:0.0:1789265561.304551:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+20:2400:x1876180556932224:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265561.304573:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265561.304582:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4575 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919397 expref: 20 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.304598:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4575 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919397 expref: 20 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.304628:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4575 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919397 expref: 20 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.304652:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:0.0:1789265561.304659:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.304672:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.304705:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.304744:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265561.304827:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+19:2400:x1876180556932224:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 276us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265561.304838:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 92 00010000:00010000:0.0:1789265561.305427:0:14174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.305439:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.305767:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.305786:0:14174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d46f6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f9 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.305798:0:14174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.306441:0:14174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d46f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f9 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.306469:0:14174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d46f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f9 expref: 19 pid: 6520 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265561.306503:0:14174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d71180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14174:1876180579018880:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265561.306642:0:14174:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775235ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265561.312024:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265561.312075:0:14174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d71180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14174:1876180579018880:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265561.312109:0:14174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265561.313267:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556932352 00000100:00100000:0.0:1789265561.313283:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556932352 00010000:00010000:0.0:1789265561.313348:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d46f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f9 expref: 20 pid: 6520 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265561.313406:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 93 00000100:00100000:0.0:1789265561.313420:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937747f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+20:2400:x1876180556932352:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265561.313443:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265561.313453:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d46f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f9 expref: 20 pid: 6520 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.313469:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d46f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f9 expref: 20 pid: 6520 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.315200:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d46f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193f9 expref: 20 pid: 6520 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.315225:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff937779d97000) 00010000:00010000:0.0:1789265561.315232:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.315245:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.315255:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.315304:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265561.315347:0:14174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.315368:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265561.315422:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+19:2400:x1876180556932352:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 1999us (3407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265561.315435:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 93 00000001:00080000:1.0:1789265561.315547:0:14174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1789265561.315699:0:14174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1789265561.315740:0:14174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1789265561.315830:0:14174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14174:1876180579019008:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789265561.315943:0:14174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265561.315983:0:14174:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265561.318291:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579019008 00000100:00100000:0.0:1789265561.318314:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579019008 00000100:00100000:0.0:1789265561.318454:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789265561.318468:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14174:x1876180579019008:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789265561.318679:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14174:x1876180579019008:12345-0@lo:1000:mdt00_004.0 Request processed in 214us (2734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265561.318689:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789265561.318763:0:14174:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1789265561.318779:0:14174:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff937643d10a80, transno 4294967316 00000100:00100000:1.0:1789265561.318806:0:14174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14174:1876180579019008:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1789265561.319028:0:14174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1789265561.319127:0:14174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14174:1876180579019136:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789265561.319204:0:14174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265561.323412:0:14174:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377461bb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265561.326247:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579019136 00000100:00100000:2.0:1789265561.326273:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579019136 00000100:00100000:2.0:1789265561.326370:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789265561.326386:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14174:x1876180579019136:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789265561.326711:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:14174:x1876180579019136:12345-0@lo:1000:mdt00_004.0 Request processed in 330us (7506us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789265561.326720:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789265561.327386:0:14174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14174:1876180579019136:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1789265561.327454:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328289:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328298:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328304:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643218200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265561.328310:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328319:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328339:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff937779d97000) 00010000:00010000:1.0:1789265561.328342:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265561.328347:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328354:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4735 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328386:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4671 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328392:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4671 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328398:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4671 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328403:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393c00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265561.328412:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4671 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328419:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4671 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328427:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:1.0:1789265561.328430:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265561.328433:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4671 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328439:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4671 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328975:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.328996:0:14174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d468d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193dd expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.329049:0:14174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.329101:0:14174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d468d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193dd expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.329119:0:14174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d468d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193dd expref: 22 pid: 6519 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265561.329138:0:14174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14174:1876180579019264:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265561.329265:0:14174:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265561.334104:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265561.334235:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556932480 00000100:00100000:0.0:1789265561.334253:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556932480 00010000:00010000:0.0:1789265561.334318:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d468d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193dd expref: 23 pid: 6519 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265561.334377:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 94 00000100:00100000:0.0:1789265561.334390:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642419880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+23:2399:x1876180556932480:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265561.334411:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265561.334420:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d468d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193dd expref: 23 pid: 6519 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.334435:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d468d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193dd expref: 23 pid: 6519 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.334465:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:0.0:1789265561.334470:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.334764:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d468d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9193dd expref: 23 pid: 6519 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265561.334784:0:14174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14174:1876180579019264:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265561.335195:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.335204:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.338749:0:14174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265561.339914:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265561.340269:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642419880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+22:2399:x1876180556932480:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 5870us (6167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265561.340286:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 94 00010000:00010000:1.0:1789265561.340340:0:14174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340351:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340367:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340374:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340381:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340387:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265561.340392:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340401:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340423:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:1.0:1789265561.340427:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265561.340431:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340437:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d473c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340469:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340487:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340493:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340498:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bde00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265561.340501:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340507:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340516:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff937779d97800) 00010000:00010000:1.0:1789265561.340518:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265561.340520:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.340526:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d472e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265561.340813:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265561.340819:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265561.342665:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1789265561.342693:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265561.342906:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937747f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+21:12381:x1876180556932096:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 49725us (49934us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789265561.342940:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 201 00000020:00080000:1.0:1789265561.342950:0:14174:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789265561.358732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265561.359021:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556932736 00000100:00100000:3.0:1789265561.359035:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556932736 00000100:00100000:3.0:1789265561.359103:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:3.0:1789265561.359118:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779d30050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+21:12381:x1876180556932736:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789265561.359472:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789265561.359515:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1789265561.359553:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4743 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.359574:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4743 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.359588:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4743 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.359604:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4743 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.359611:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4743 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.359618:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4743 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.359652:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789265561.359768:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779d30050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+23:12381:x1876180556932736:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 652us (1048us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789265561.359778:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 50 00000020:00080000:3.0:1789265561.359785:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789265561.359963:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265561.359971:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4743 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.359981:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5800 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265561.359985:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4743 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.359996:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4743 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.360013:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff937779d97000) 00010000:00010000:3.0:1789265561.360016:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789265561.360022:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4743 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.360036:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4743 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265561.360052:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265561.360054:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265561.360056:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265561.781294:0:14659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265561.781310:0:14659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265561.781349:0:14659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789265561.781360:0:14659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265561.954558:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265561.954652:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556932992 00000100:00100000:2.0:1789265561.954667:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556932992 00000100:00100000:2.0:1789265561.954747:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 202 00000100:00100000:2.0:1789265561.954759:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+23:12391:x1876180556932992:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265561.954812:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265561.954850:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d474a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919415 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.955075:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d4751 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.955093:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d4751 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.955108:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d4751 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265561.955122:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789265561.955266:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d474a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919415 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.955287:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d4751 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919415 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265561.955297:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:2.0:1789265561.955301:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265561.955304:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc200, rc 0) 00000100:00100000:2.0:1789265561.955382:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+25:12391:x1876180556932992:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 625us (840us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789265561.955389:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 202 00000100:00100000:0.0:1789265561.966906:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265561.967203:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556933120 00000100:00100000:1.0:1789265561.967217:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556933120 00000100:00100000:1.0:1789265561.967292:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 203 00000100:00100000:1.0:1789265561.967305:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+25:12391:x1876180556933120:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:1.0:1789265561.967408:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d475f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.967431:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d475f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.967446:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d475f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.967465:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4766 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.967472:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.967479:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.967585:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d476d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.967594:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d476d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.967616:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d476d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265561.968092:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d476d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968111:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d475f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968119:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d475f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968127:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d475f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968134:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265561.968139:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d475f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968148:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d475f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968162:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:1.0:1789265561.968165:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265561.968172:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d475f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968178:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d475f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968191:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968206:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4766 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968212:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968217:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265561.968221:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968228:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4766 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968237:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774f2ef400) 00010000:00010000:1.0:1789265561.968239:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265561.968243:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4766 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968248:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4766 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968266:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d476d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968274:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d476d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968279:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d476d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968284:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bcc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265561.968293:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d476d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968300:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d476d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968309:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774f2ef000) 00010000:00010000:1.0:1789265561.968312:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265561.968315:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d476d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265561.968321:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d476d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265561.968432:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+25:12391:x1876180556933120:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 1125us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265561.968442:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 203 00000100:00100000:3.0:1789265562.021586:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.021633:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556933376 00000100:00100000:3.0:1789265562.021648:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556933376 00000100:00100000:3.0:1789265562.021721:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 204 00000100:00100000:3.0:1789265562.021735:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+25:12394:x1876180556933376:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265562.021763:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265562.021791:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d4774 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91941c expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023072:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d477b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023108:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d477b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023124:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d477b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023145:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4782 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023154:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023184:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023345:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4789 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023355:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4789 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023363:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4789 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265562.023375:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789265562.023477:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d477b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023487:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d477b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023494:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d477b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023502:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265562.023507:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d477b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023516:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d477b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023531:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:3.0:1789265562.023535:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265562.023547:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d477b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023554:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d477b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023574:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023581:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4782 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023586:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4782 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023591:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265562.023594:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4782 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023600:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4782 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023608:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575c00) 00010000:00010000:3.0:1789265562.023610:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265562.023613:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4782 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023619:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4782 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023684:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d4774 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91941c expref: 28 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023714:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4789 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91941c expref: 27 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.023722:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:3.0:1789265562.023724:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265562.023727:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a4c00, rc 0) 00000100:00100000:3.0:1789265562.023824:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+27:12394:x1876180556933376:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 2092us (2253us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789265562.023835:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 204 00000100:00100000:0.0:1789265562.038742:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.040069:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556933504 00000100:00100000:3.0:1789265562.040089:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556933504 00000100:00100000:3.0:1789265562.040169:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 205 00000100:00100000:3.0:1789265562.040182:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+27:12394:x1876180556933504:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:3.0:1789265562.040271:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4797 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.040292:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.040308:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.040353:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.040361:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4797 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.040391:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.040398:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265562.040403:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.040412:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4797 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.040428:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:3.0:1789265562.040432:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265562.040437:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4797 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.040444:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d4797 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265562.040542:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+27:12394:x1876180556933504:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 362us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265562.040549:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 205 00000100:00100000:0.0:1789265562.061786:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.062173:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556933760 00000100:00100000:3.0:1789265562.062189:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556933760 00000100:00100000:3.0:1789265562.062377:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:3.0:1789265562.062392:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+27:12394:x1876180556933760:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1789265562.062714:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+28:12394:x1876180556933760:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 324us (942us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789265562.062723:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:3.0:1789265562.092098:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265562.092273:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556934016 00000100:00100000:1.0:1789265562.092289:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556934016 00000100:00100000:1.0:1789265562.092372:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 206 00000100:00100000:1.0:1789265562.092384:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+28:11926:x1876180556934016:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1789265562.092417:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265562.092443:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d479e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919423 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.092594:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.092612:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4789 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91941c expref: 29 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.092644:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.092778:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4789 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91941c expref: 29 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.092794:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4789 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91941c expref: 29 pid: 14174 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265562.092809:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764241ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579019392:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265562.093121:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042600 going to sleep for 11 seconds 00000100:00100000:1.0:1789265562.097580:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764241ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579019392:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265562.097628:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265562.099451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265562.099607:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556934144 00000100:00100000:1.0:1789265562.099620:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556934144 00010000:00010000:1.0:1789265562.099675:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4789 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91941c expref: 30 pid: 14174 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265562.099728:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 95 00000100:00100000:1.0:1789265562.099740:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+30:2399:x1876180556934144:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265562.099759:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265562.099768:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4789 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91941c expref: 30 pid: 14174 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.099811:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4789 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91941c expref: 30 pid: 14174 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.099854:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4c00/0xbbfdc9019c1d4789 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91941c expref: 30 pid: 14174 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.099899:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:1.0:1789265562.099906:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.099928:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.099937:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.099969:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265562.100042:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+29:2399:x1876180556934144:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 303us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265562.100050:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 95 00010000:00010000:1.0:1789265562.100187:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.100196:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265562.100223:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789265562.100401:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d479e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919423 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.100433:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919423 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.100440:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:1.0:1789265562.100443:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265562.100445:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd400, rc 0) 00000100:00100000:1.0:1789265562.100482:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+29:11926:x1876180556934016:12345-192.168.202.42@tcp:101:bash.0 Request processed in 8101us (8658us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1789265562.100490:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 206 00000100:00100000:1.0:1789265562.104420:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.104521:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556934272 00000100:00100000:3.0:1789265562.104538:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556934272 00000100:00100000:3.0:1789265562.104629:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 207 00000100:00100000:3.0:1789265562.104643:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+29:11926:x1876180556934272:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1789265562.104681:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265562.104713:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d47b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91942a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.104760:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d47ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.104779:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d47ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.104793:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d47ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.105215:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5200/0xbbfdc9019c1d47b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91942a expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.105241:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d47ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91942a expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.105251:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:3.0:1789265562.105255:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789265562.105259:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a4200, rc 0) 00000100:00100000:3.0:1789265562.105334:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+30:11926:x1876180556934272:12345-192.168.202.42@tcp:101:bash.0 Request processed in 695us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265562.105350:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 207 00000100:00100000:2.0:1789265562.109183:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.109289:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556934528 00000100:00100000:3.0:1789265562.109304:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556934528 00000100:00100000:3.0:1789265562.109380:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 208 00000100:00100000:3.0:1789265562.109392:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+30:11926:x1876180556934528:12345-192.168.202.42@tcp:36:bash.0 00010000:00010000:3.0:1789265562.110081:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d47c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.110104:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d47c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.110117:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d47c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265562.110173:0:9988:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1789265562.110199:0:9988:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f78c47c reply state 0000000063765efa transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d47c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.110213:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d47c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.110221:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:3.0:1789265562.110225:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265562.110229:0:9988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789265562.110272:0:9988:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1789265562.110413:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+34:11926:x1876180556934528:12345-192.168.202.42@tcp:36:bash.0 Request processed in 1021us (1242us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789265562.110422:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 208 00000020:00080000:3.0:1789265562.110429:0:9988:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789265562.115644:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265562.120029:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556934656 00000100:00100000:2.0:1789265562.120055:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556934656 00000100:00100000:2.0:1789265562.120717:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 209 00000100:00100000:2.0:1789265562.120734:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764241bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+34:11926:x1876180556934656:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1789265562.120770:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265562.120797:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d47c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919431 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.120953:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d47c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919431 expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.120974:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d47c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919431 expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.121003:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:2.0:1789265562.121006:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265562.121012:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fde00, rc 0) 00000100:00100000:2.0:1789265562.121169:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764241bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+35:11926:x1876180556934656:12345-192.168.202.42@tcp:101:bash.0 Request processed in 439us (5539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265562.121177:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 209 00000100:00100000:1.0:1789265562.133622:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.133735:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556934784 00000100:00100000:3.0:1789265562.133748:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556934784 00000100:00100000:3.0:1789265562.133949:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:3.0:1789265562.133963:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+7:11926:x1876180556934784:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1789265562.133989:0:9789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265562.134020:0:9789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074c52a58/0xbbfdc9019c1d47cf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919438 expref: -99 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265562.134054:0:9789:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa60699, atime: 0x6aa60697, ctime: 0x6aa60699, blocks: 0x8 00010000:00010000:3.0:1789265562.134084:0:9789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=417s v=(0 0) 00010000:00010000:3.0:1789265562.134090:0:9789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265562.134100:0:9789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074c52a58/0xbbfdc9019c1d47cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919438 expref: 8 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.134123:0:9789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074c52a58/0xbbfdc9019c1d47cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919438 expref: 8 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.134139:0:9789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a5200, rc 0) 00000100:00100000:3.0:1789265562.134202:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+8:11926:x1876180556934784:12345-192.168.202.42@tcp:101:bash.0 Request processed in 243us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265562.134210:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:1.0:1789265562.136849:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.137048:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556934912 00000100:00100000:3.0:1789265562.137061:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556934912 00002000:00010000:3.0:1789265562.137118:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1789265562.137123:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93777f466680 with x1876180556934912 ext(0->18446744073709551615) 00002000:00010000:3.0:1789265562.137139:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93777f466680. 00000100:00100000:3.0:1789265562.137168:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:3.0:1789265562.137198:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2400:x1876180556934912:12345-192.168.202.42@tcp:10:bash.0 00002000:00010000:3.0:1789265562.137543:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789265562.137547:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789265561 -> 1789265563 00002000:00010000:3.0:1789265562.137550:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789265559 -> 1789265559 00002000:00010000:3.0:1789265562.137553:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789265561 -> 1789265563 00002000:00010000:3.0:1789265562.137555:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1789265562.137630:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2400:x1876180556934912:12345-192.168.202.42@tcp:10:bash.0 Request processed in 433us (806us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789265562.137638:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00002000:00010000:3.0:1789265562.137642:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1789265562.137645:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93777f466680 with x1876180556934912 ext(0->18446744073709551615) 00002000:00010000:3.0:1789265562.137650:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93777f466680. 00010000:00010000:2.0:1789265562.163290:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265562.200395:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265562.200506:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556935040 00000100:00100000:2.0:1789265562.200520:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556935040 00000100:00100000:2.0:1789265562.200611:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 210 00000100:00100000:2.0:1789265562.200625:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+35:12408:x1876180556935040:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:2.0:1789265562.200749:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d47d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.200772:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d47d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.200808:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d47d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.200830:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d47dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.200852:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d47dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.200903:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d47dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201197:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d47e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201209:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d47e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201216:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d47e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265562.201274:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d47e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201289:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d47d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201296:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d47d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201304:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d47d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201321:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265562.201327:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d47d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201336:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d47d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201351:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:2.0:1789265562.201354:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265562.201424:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d47d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201432:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d47d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201449:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d47dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201454:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d47dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201459:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d47dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201463:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265562.201465:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d47dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201471:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d47dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201509:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9377522fe500) 00010000:00010000:2.0:1789265562.201512:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265562.201515:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d47dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201521:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d47dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201540:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d47e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201546:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d47e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201553:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d47e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201559:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265562.201562:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d47e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201568:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d47e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201576:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:2.0:1789265562.201578:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265562.201582:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d47e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.201587:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d47e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265562.202139:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+35:12408:x1876180556935040:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 1509us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265562.202151:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 210 00000100:00100000:1.0:1789265562.233620:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.234213:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556935296 00000100:00100000:3.0:1789265562.234229:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556935296 00000100:00100000:3.0:1789265562.234368:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 211 00000100:00100000:3.0:1789265562.234381:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+35:12411:x1876180556935296:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265562.234409:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265562.234437:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d47eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91943f expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.234538:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d47f2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.234556:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d47f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.234587:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d47f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.234622:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d47f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.234632:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d47f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.234639:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d47f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.234795:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d4800 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.234807:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d4800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.234814:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d4800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265562.234825:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789265562.235129:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d47f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235139:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d47f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235147:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d47f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235153:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265562.235158:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d47f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235177:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d47f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235191:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:3.0:1789265562.235194:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265562.235198:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d47f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235204:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d47f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235223:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d47f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235228:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d47f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235233:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d47f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235237:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265562.235239:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d47f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235243:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d47f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235249:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575100) 00010000:00010000:3.0:1789265562.235252:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265562.235254:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d47f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235269:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d47f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235321:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d47eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91943f expref: 38 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235335:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d4800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91943f expref: 37 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.235343:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:3.0:1789265562.235346:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789265562.235348:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a4600, rc 0) 00000100:00100000:3.0:1789265562.235440:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+37:12411:x1876180556935296:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 1061us (1834us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789265562.235447:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 211 00000100:00100000:0.0:1789265562.239423:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265562.239519:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556935424 00000100:00100000:2.0:1789265562.239533:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556935424 00000100:00100000:2.0:1789265562.239625:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 212 00000100:00100000:2.0:1789265562.239638:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+37:12411:x1876180556935424:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:2.0:1789265562.240067:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.240091:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919423 expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.240101:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.240158:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919423 expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.240175:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919423 expref: 37 pid: 6519 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265562.240193:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579019520:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265562.240355:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff937757b13000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265562.244038:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579019520:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265562.244088:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265562.247131:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265562.247350:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556935680 00000100:00100000:1.0:1789265562.247364:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556935680 00000100:00100000:1.0:1789265562.247476:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:1.0:1789265562.247489:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+38:6170:x1876180556935680:12345-192.168.202.42@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789265562.248328:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+39:6170:x1876180556935680:12345-192.168.202.42@tcp:35:ldlm_bl.0 Request processed in 430us (800us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789265562.248340:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:1.0:1789265562.251403:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.251512:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556935808 00000100:00100000:3.0:1789265562.251526:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556935808 00010000:00010000:3.0:1789265562.251635:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919423 expref: 39 pid: 6519 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265562.251694:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 96 00000100:00100000:3.0:1789265562.251707:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377583dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+39:2400:x1876180556935808:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265562.251726:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265562.251734:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919423 expref: 39 pid: 6519 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.251776:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919423 expref: 39 pid: 6519 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.251804:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d47a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919423 expref: 39 pid: 6519 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.251828:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:3.0:1789265562.252138:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.252150:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.252159:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.252245:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265562.252314:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377583dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+38:2400:x1876180556935808:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 609us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265562.252322:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 96 00010000:00010000:0.0:1789265562.253603:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.253620:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.253749:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.253758:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.253767:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.253775:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265562.253780:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.253810:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.254111:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:0.0:1789265562.254115:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265562.254122:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.254130:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d480e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265562.254303:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+37:12411:x1876180556935424:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 14662us (14892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265562.254315:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 212 00000100:00100000:1.0:1789265562.258156:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.258297:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556936064 00000100:00100000:3.0:1789265562.258312:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556936064 00000100:00100000:3.0:1789265562.258425:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:3.0:1789265562.258439:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+37:12411:x1876180556936064:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1789265562.258767:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+38:12411:x1876180556936064:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 331us (940us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789265562.258776:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:1.0:1789265562.356399:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265562.358084:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556936320 00000100:00100000:2.0:1789265562.358106:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556936320 00000100:00100000:2.0:1789265562.358266:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 213 00000100:00100000:2.0:1789265562.358281:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376426dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+38:12422:x1876180556936320:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:2.0:1789265562.358323:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265562.358356:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4815 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919446 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.358468:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d481c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.358488:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d481c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.358507:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d481c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.358524:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4823 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.358531:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.358538:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.358704:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d482a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.358715:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d482a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.358741:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d482a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265562.358752:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789265562.358904:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d481c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.358913:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d481c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359056:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d481c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359064:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265562.359070:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d481c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359079:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d481c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359094:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:2.0:1789265562.359097:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265562.359102:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d481c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359109:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d481c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359129:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359136:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4823 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359149:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4823 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359154:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fdc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265562.359157:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4823 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359164:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4823 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359173:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9377522fe500) 00010000:00010000:2.0:1789265562.359175:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265562.359178:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4823 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359185:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4823 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359241:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4815 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919446 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359258:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d482a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919446 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.359266:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:2.0:1789265562.359268:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265562.359270:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd600, rc 0) 00000100:00100000:2.0:1789265562.359422:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376426dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+40:12422:x1876180556936320:12345-192.168.202.42@tcp:101:cat.0 Request processed in 1143us (3036us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789265562.359439:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 213 00000100:00100000:0.0:1789265562.366178:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265562.366398:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556936576 00000100:00100000:1.0:1789265562.366412:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556936576 00000100:00100000:1.0:1789265562.366486:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:1.0:1789265562.366499:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+40:12422:x1876180556936576:12345-192.168.202.42@tcp:35:cat.0 00000100:00100000:1.0:1789265562.367038:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+41:12422:x1876180556936576:12345-192.168.202.42@tcp:35:cat.0 Request processed in 538us (871us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789265562.367047:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:1.0:1789265562.386398:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.386506:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556936832 00000100:00100000:3.0:1789265562.386523:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556936832 00000100:00100000:3.0:1789265562.386930:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 214 00000100:00100000:3.0:1789265562.386946:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+41:12423:x1876180556936832:12345-192.168.202.42@tcp:36:rm.0 00010000:00010000:3.0:1789265562.387073:0:9988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789265562.387110:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d47c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919431 expref: 41 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.387140:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d482a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919446 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.387154:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d4800 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91943f expref: 39 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.387171:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d47ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91942a expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.387182:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:3.0:1789265562.387187:0:9988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265562.387217:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4838 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.387233:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4838 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.387244:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4838 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.387261:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d483f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.387275:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d483f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.387282:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d483f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.387384:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4846 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.387432:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4846 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.387440:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4846 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265562.389191:0:9988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1789265562.389209:0:9988:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418050348938ns, next at 419050344675ns, rc = 0 00010000:00010000:2.0:1789265562.389295:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d484d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389314:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d484d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389326:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d484d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389335:0:9988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d484d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389342:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d484d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389349:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d484d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389430:0:9988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265562.389460:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4846 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389467:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4846 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389473:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4846 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389480:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265562.389502:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4846 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389511:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4846 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389527:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:2.0:1789265562.389531:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789265562.389536:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4846 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389544:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5800/0xbbfdc9019c1d4846 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389582:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4838 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389588:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4838 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389594:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4838 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389599:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265562.389601:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4838 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389608:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4838 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389615:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:2.0:1789265562.389618:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265562.389628:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4838 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389634:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4400/0xbbfdc9019c1d4838 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265562.389649:0:9988:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000535ece22 reply state 00000000122cb32c transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d483f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389771:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d483f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.389778:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575100) 00010000:00010000:2.0:1789265562.389781:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265562.389784:0:9988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265562.390221:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+39:12423:x1876180556936832:12345-192.168.202.42@tcp:36:rm.0 Request processed in 3274us (3831us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789265562.390231:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 214 00010000:00010000:0.0:1789265562.393138:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265562.393159:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d484d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.393173:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265562.393178:0:13735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d484d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.393191:0:13735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d484d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.393216:0:13735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:0.0:1789265562.393220:0:13735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789265562.393226:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d484d lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.393262:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d484d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.393290:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265562.393292:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265562.393294:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265562.442086:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265562.442279:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556937088 00000100:00100000:2.0:1789265562.442293:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556937088 00000100:00100000:2.0:1789265562.442411:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 215 00000100:00100000:2.0:1789265562.442423:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+39:12429:x1876180556937088:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1789265562.442453:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265562.442478:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4854 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91944d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.442602:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d485b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.442620:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d485b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.442667:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d485b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.442680:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4862 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.442688:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4862 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.442695:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4862 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265562.443521:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789265562.443708:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4869 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.443722:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.443733:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.443768:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d485b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.443776:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d485b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.443784:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d485b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.443790:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265562.443807:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d485b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.443817:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d485b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.443831:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:2.0:1789265562.443846:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265562.443852:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d485b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.444805:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d485b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265562.444843:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2b63e7e reply state 000000000352e0aa transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4862 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.446151:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4862 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.446176:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575100) 00010000:00010000:2.0:1789265562.446179:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265562.446185:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789265562.446267:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4854 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91944d expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.446295:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4869 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91944d expref: 41 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.446304:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522fe500) 00010000:00010000:2.0:1789265562.446306:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265562.446336:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd400, rc 0) 00000100:00100000:2.0:1789265562.446437:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+42:12429:x1876180556937088:12345-192.168.202.42@tcp:101:bash.0 Request processed in 4012us (4363us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789265562.446448:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 215 00000100:00100000:3.0:1789265562.452112:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265562.452402:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556937216 00000100:00100000:1.0:1789265562.452416:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556937216 00000100:00100000:1.0:1789265562.452514:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:1.0:1789265562.452528:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2400:x1876180556937216:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1789265562.452552:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265562.452578:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d4877 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919454 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265562.452609:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265562.452634:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=418s v=(0 0) 00010000:00010000:1.0:1789265562.452639:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265562.452650:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d4877 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919454 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.452684:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d4877 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919454 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.452702:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd800, rc 0) 00000100:00100000:1.0:1789265562.452802:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2400:x1876180556937216:12345-192.168.202.42@tcp:101:bash.0 Request processed in 277us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265562.452810:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00080000:3.0:1789265562.455890:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265562.471456:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265562.471572:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556937344 00000100:00100000:0.0:1789265562.471588:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556937344 00000100:00100000:0.0:1789265562.471730:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:0.0:1789265562.471744:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+8:12429:x1876180556937344:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1789265562.471768:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265562.471793:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91945b expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.472088:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d4877 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919454 expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.472100:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265562.472106:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265562.472112:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.472159:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d4877 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919454 expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.472175:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d4877 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919454 expref: 9 pid: 8434 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265562.472210:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f36fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1876180579019648:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265562.472416:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775235aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265562.476201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265562.476319:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556937472 00000100:00100000:2.0:1789265562.476333:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556937472 00010000:00010000:2.0:1789265562.476387:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d4877 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919454 expref: 10 pid: 8434 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265562.476439:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 97 00000100:00100000:2.0:1789265562.476453:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+10:2400:x1876180556937472:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265562.476475:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265562.476507:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d4877 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919454 expref: 10 pid: 8434 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.476524:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d4877 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919454 expref: 10 pid: 8434 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.476559:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265562.476576:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265562.476587:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.476598:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.476649:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265562.476816:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f4f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1876180579019776:192.168.202.42@tcp:105: 00000100:00100000:2.0:1789265562.477098:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377543c59c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789265562.477532:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d4877 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919454 expref: 10 pid: 8434 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265562.477554:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f36fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1876180579019648:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265562.477598:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.477612:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643218200, rc 0) 00000100:00100000:1.0:1789265562.477675:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+9:12429:x1876180556937344:12345-192.168.202.42@tcp:101:bash.0 Request processed in 5934us (6236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265562.477684:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:0.0:1789265562.490744:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265562.490815:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556937728 00000100:00100000:1.0:1789265562.490828:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556937728 00000100:00100000:1.0:1789265562.490947:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:1.0:1789265562.490962:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+42:12429:x1876180556937728:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:1.0:1789265562.491328:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+43:12429:x1876180556937728:12345-192.168.202.42@tcp:35:bash.0 Request processed in 370us (599us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789265562.491334:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:2.0:1789265562.491603:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f4f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1876180579019776:192.168.202.42@tcp:105: 00010000:00010000:2.0:1789265562.491635:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265562.491670:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f36d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2400:x1876180556937472:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 15220us (15485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265562.491680:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 97 00000100:00100000:0.0:1789265562.688026:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265562.689444:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556937856 00000100:00100000:2.0:1789265562.689462:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556937856 00000100:00100000:2.0:1789265562.689550:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 216 00000100:00100000:2.0:1789265562.689564:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+43:12445:x1876180556937856:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265562.689606:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265562.689638:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4885 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919462 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.689742:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d488c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.689762:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d488c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.689775:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d488c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265562.689825:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789265562.689829:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265562.690095:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d488c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.690121:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4885 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919462 expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.690140:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d488c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919462 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.690148:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:2.0:1789265562.690150:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265562.690153:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd800, rc 0) 00000100:00100000:2.0:1789265562.690468:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+44:12445:x1876180556937856:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 907us (2461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265562.690476:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 216 00000100:00100000:2.0:1789265562.695104:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.695210:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556938112 00000100:00100000:3.0:1789265562.695225:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556938112 00000100:00100000:3.0:1789265562.695310:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 217 00000100:00100000:3.0:1789265562.695322:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f4f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+44:12445:x1876180556938112:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265562.695348:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265562.695378:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d4893 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919469 expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.695518:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d489a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.695535:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d489a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.695590:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d489a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265562.695604:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789265562.695774:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d4893 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919469 expref: 47 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.695800:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d489a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919469 expref: 46 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.695809:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522fe500) 00010000:00010000:3.0:1789265562.695812:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265562.695816:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a4200, rc 0) 00000100:00100000:3.0:1789265562.695948:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f4f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+46:12445:x1876180556938112:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 627us (859us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1789265562.695955:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 217 00000100:00100000:0.0:1789265562.699641:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265562.699767:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556938368 00000100:00100000:2.0:1789265562.699783:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556938368 00000100:00100000:2.0:1789265562.699917:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 218 00000100:00100000:2.0:1789265562.699932:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+46:12445:x1876180556938368:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265562.699971:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265562.700005:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d48a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919470 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.700154:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d48af lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.700173:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d48af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.700216:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d48af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265562.700233:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789265562.700375:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d48a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919470 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.700399:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d48af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919470 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.700409:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522fe500) 00010000:00010000:2.0:1789265562.700413:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789265562.700417:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd600, rc 0) 00000100:00100000:2.0:1789265562.700502:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+48:12445:x1876180556938368:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 573us (874us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1789265562.700509:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 218 00000100:00100000:0.0:1789265562.707772:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265562.708042:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.708129:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556938624 00000100:00100000:3.0:1789265562.708142:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556938624 00000100:00100000:3.0:1789265562.708230:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:3.0:1789265562.708243:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+48:2400:x1876180556938624:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265562.708263:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265562.708293:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d489a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919469 expref: 48 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.708319:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522fe500) 00010000:00010000:3.0:1789265562.708324:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265562.708423:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+47:2400:x1876180556938624:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 182us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265562.708431:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:1.0:1789265562.710265:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556938496 00000100:00100000:1.0:1789265562.710284:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556938496 00000100:00100000:1.0:1789265562.710411:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:1.0:1789265562.710424:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2398:x1876180556938496:12345-192.168.202.42@tcp:1:lfs.0 00010000:00010000:1.0:1789265562.710516:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d48bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.710545:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.710556:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265562.710561:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265562.710742:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d48bd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.710797:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.710817:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 8 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265562.710970:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1876180579019904:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265562.711148:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265562.717329:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.717382:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556938752 00000100:00100000:3.0:1789265562.717395:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556938752 00002000:00100000:3.0:1789265562.717467:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9376435abb80 x1876180556938752/t0(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:133/0 lens 504/0 e 0 to 0 dl 1789265573 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789265562.717481:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9376435abb80 with x1876180556938752 ext(0->8) 00010000:00010000:3.0:1789265562.717493:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 9 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.717514:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 9 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265562.717522:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9376435abb80 00000100:00100000:3.0:1789265562.717555:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:3.0:1789265562.717567:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2400:x1876180556938752:12345-192.168.202.42@tcp:4:lfs.0 00000100:00100000:1.0:1789265562.718533:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1876180579019904:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265562.718570:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d48bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265562.725497:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+11:2400:x1876180556938752:12345-192.168.202.42@tcp:4:lfs.0 Request processed in 7913us (8166us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789265562.725550:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00002000:00100000:1.0:1789265562.725572:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9376435abb80 x1876180556938752/t4294967309(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:133/0 lens 504/448 e 0 to 0 dl 1789265573 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789265562.725584:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9376435abb80 with x1876180556938752 ext(0->8) 00010000:00010000:1.0:1789265562.725600:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 11 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.725623:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 11 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265562.725631:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9376435abb80 00000100:00100000:2.0:1789265562.729643:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.729808:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556938880 00000100:00100000:3.0:1789265562.729822:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556938880 00010000:00010000:3.0:1789265562.730084:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 11 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265562.730144:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 98 00000100:00100000:3.0:1789265562.730157:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+11:2397:x1876180556938880:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265562.730192:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789265562.730240:0:6504:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789265562.730244:0:6504:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789265563 00002000:00010000:3.0:1789265562.730246:0:6504:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789265563 00002000:00010000:3.0:1789265562.730249:0:6504:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789265563 00002000:00010000:3.0:1789265562.730251:0:6504:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789265562.730259:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 11 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.730276:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 11 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.730307:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0cb3c69/0xbbfdc9019c1d487e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91945b expref: 11 pid: 8435 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.730329:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265562.730335:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265562.730341:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d48bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.730354:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d48bd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.730398:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265562.730465:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+10:2397:x1876180556938880:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 310us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265562.730473:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 98 00010000:00010000:0.0:1789265562.730554:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d48bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.730576:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d48bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.730603:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d48bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.730612:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d48bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.730621:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d48bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.730628:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd800 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265562.730643:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d48bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.730662:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d48bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.730675:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d48bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.730683:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c075262/0xbbfdc9019c1d48bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265562.730741:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2398:x1876180556938496:12345-192.168.202.42@tcp:1:lfs.0 Request processed in 20320us (22986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265562.730750:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:0.0:1789265562.733728:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.733817:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556939136 00000100:00100000:3.0:1789265562.733907:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556939136 00000100:00100000:3.0:1789265562.733992:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:3.0:1789265562.734004:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937779d33c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+47:12445:x1876180556939136:12345-192.168.202.42@tcp:35:lfs.0 00000004:00010000:3.0:1789265562.734100:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d48af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919470 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265562.734345:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1789265562.734377:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1789265562.734762:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1789265562.734809:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.734828:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4869 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91944d expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.734848:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.734935:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4869 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91944d expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.734955:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4869 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91944d expref: 51 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265562.734973:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876180579020032:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265562.735093:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744664c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265562.739147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.739363:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876180579020032:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265562.739411:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265562.740163:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556939264 00000100:00100000:2.0:1789265562.740176:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556939264 00010000:00010000:2.0:1789265562.740295:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4869 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91944d expref: 52 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265562.740503:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 99 00000100:00100000:1.0:1789265562.740516:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+52:2399:x1876180556939264:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265562.740537:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265562.740544:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4869 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91944d expref: 52 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.740557:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4869 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91944d expref: 52 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.740583:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4869 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91944d expref: 52 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.740605:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522fe500) 00010000:00010000:1.0:1789265562.740622:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.740633:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.740640:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.740681:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265562.740759:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+51:2399:x1876180556939264:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 246us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265562.740768:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 99 00010000:00010000:3.0:1789265562.741076:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.741086:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265562.741259:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1789265562.741404:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1789265562.741521:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876180579020160:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789265562.741606:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265562.741645:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744664840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265562.742008:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579020160 00000100:00100000:2.0:1789265562.742018:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579020160 00000100:00100000:2.0:1789265562.742082:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789265562.742093:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1876180579020160:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789265562.742234:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1876180579020160:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 141us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265562.742263:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:3.0:1789265562.742616:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265562.742706:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876180579020160:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789265562.742939:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1789265562.743026:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876180579020288:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789265562.743073:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265562.743100:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377446649c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265562.743627:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579020288 00000100:00100000:2.0:1789265562.743635:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579020288 00000100:00100000:2.0:1789265562.743693:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789265562.743702:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6523:x1876180579020288:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789265562.743886:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6523:x1876180579020288:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 157us (785us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789265562.743894:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789265562.744373:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876180579020288:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789265562.744440:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1789265562.744482:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.744493:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.744502:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.744527:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265562.744532:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.744542:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.744573:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522fe500) 00010000:00010000:3.0:1789265562.744576:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789265562.744582:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.744589:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d48c4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265562.744714:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789265562.744785:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1789265562.744796:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 418405936215ns, next at 419405933834ns, rc = 0 00000001:00080000:3.0:1789265562.744802:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1789265562.744823:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522fe500) 00010000:00010000:3.0:1789265562.744825:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789265562.745024:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d48af lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919470 expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265562.745155:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937779d33c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+54:12445:x1876180556939136:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 11152us (11442us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789265562.745165:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 56 00000020:00080000:3.0:1789265562.745170:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789265562.747626:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265562.747787:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556939392 00000100:00100000:2.0:1789265562.747802:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556939392 00000100:00100000:2.0:1789265562.748014:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 219 00000100:00100000:2.0:1789265562.748029:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+54:12445:x1876180556939392:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265562.748063:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265562.748093:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d48cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919477 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.748173:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d48cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919477 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.748192:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d48cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919477 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.748216:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:2.0:1789265562.748220:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265562.748225:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fde00, rc 0) 00000100:00100000:2.0:1789265562.748293:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+55:12445:x1876180556939392:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 267us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265562.748319:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 219 00000100:00100000:2.0:1789265562.752010:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265562.752127:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556939648 00000100:00100000:1.0:1789265562.752142:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556939648 00000100:00100000:1.0:1789265562.752215:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:1.0:1789265562.752227:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+55:12445:x1876180556939648:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:1.0:1789265562.752589:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+56:12445:x1876180556939648:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 363us (595us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789265562.752597:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:0.0:1789265562.843285:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265562.843411:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556939776 00000100:00100000:2.0:1789265562.843426:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556939776 00000100:00100000:2.0:1789265562.843504:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 220 00000100:00100000:2.0:1789265562.843517:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+56:12455:x1876180556939776:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:2.0:1789265562.843643:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d48d2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.843678:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d48d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.843695:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d48d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.843710:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d48d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.843719:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d48d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.843727:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d48d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.843841:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d48e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.843853:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d48e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.843914:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d48e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265562.844008:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d48e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844028:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d48d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844036:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d48d2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844044:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d48d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844051:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265562.844056:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d48d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844064:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d48d2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844079:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:2.0:1789265562.844082:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265562.844088:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d48d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844095:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d48d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844114:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d48d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844120:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d48d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844132:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d48d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844138:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265562.844140:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d48d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844147:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d48d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844155:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575100) 00010000:00010000:2.0:1789265562.844157:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265562.844160:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d48d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844166:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d48d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844177:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d48e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844182:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d48e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844188:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d48e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844194:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fdc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265562.844196:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d48e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844212:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d48e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844221:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:2.0:1789265562.844223:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265562.844226:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d48e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.844232:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d48e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265562.844338:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+56:12455:x1876180556939776:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 822us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265562.844348:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 220 00000100:00100000:2.0:1789265562.878463:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265562.878601:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556940032 00000100:00100000:1.0:1789265562.878617:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556940032 00000100:00100000:1.0:1789265562.878710:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 221 00000100:00100000:1.0:1789265562.878724:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+56:12458:x1876180556940032:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1789265562.878751:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265562.878779:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d48e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91947e expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.878981:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d48ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879001:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d48ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879016:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d48ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879029:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d48f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879037:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d48f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879045:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d48f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879197:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d48fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879207:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d48fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879215:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d48fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265562.879226:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789265562.879340:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d48ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879362:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d48ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879370:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d48ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879377:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265562.879383:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d48ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879392:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d48ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879408:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:1.0:1789265562.879412:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265562.879417:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d48ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879424:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d48ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879440:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d48f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879447:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d48f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879453:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d48f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879458:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bcc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265562.879468:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d48f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879475:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d48f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879482:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575100) 00010000:00010000:1.0:1789265562.879485:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265562.879488:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d48f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879495:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d48f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879539:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d48e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91947e expref: 59 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879555:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d48fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91947e expref: 58 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.879564:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:1.0:1789265562.879567:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265562.879570:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd800, rc 0) 00000100:00100000:1.0:1789265562.879659:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+58:12458:x1876180556940032:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 938us (1210us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789265562.879668:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 221 00000100:00100000:3.0:1789265562.883534:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265562.883841:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556940160 00000100:00100000:2.0:1789265562.883856:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556940160 00000100:00100000:2.0:1789265562.883980:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 222 00000100:00100000:2.0:1789265562.883993:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+58:12458:x1876180556940160:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:2.0:1789265562.884092:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d490a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.884115:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d490a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.884129:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d490a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.884174:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d490a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.884201:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d490a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.884207:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d490a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.884214:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fdc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265562.884220:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d490a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.884229:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d490a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.884245:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:2.0:1789265562.884249:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265562.884254:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d490a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.884261:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d490a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265562.884355:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+58:12458:x1876180556940160:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 365us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265562.884363:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 222 00000100:00100000:0.0:1789265562.887417:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.887517:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556940416 00000100:00100000:3.0:1789265562.887531:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556940416 00000100:00100000:3.0:1789265562.887621:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:3.0:1789265562.887632:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+58:12458:x1876180556940416:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1789265562.888174:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+59:12458:x1876180556940416:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 541us (770us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789265562.888182:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:1.0:1789265562.965491:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265562.965634:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556940672 00000100:00100000:0.0:1789265562.965649:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556940672 00000100:00100000:0.0:1789265562.965738:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 223 00000100:00100000:0.0:1789265562.965753:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+59:12468:x1876180556940672:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1789265562.965794:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265562.965799:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789265562.965857:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d488c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919462 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.965973:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:0.0:1789265562.965979:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265562.966004:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4911 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919485 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.966165:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.966182:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d48fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91947e expref: 59 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.966192:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.966247:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d48fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91947e expref: 59 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.966264:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d48fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91947e expref: 59 pid: 14174 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265562.966279:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764351bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579020416:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265562.966431:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775235aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265562.971292:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764351bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579020416:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265562.971340:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265562.973679:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.973916:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556940800 00000100:00100000:3.0:1789265562.973931:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556940800 00010000:00010000:3.0:1789265562.973991:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d48fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91947e expref: 60 pid: 14174 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265562.974038:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 100 00000100:00100000:3.0:1789265562.974050:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+60:2399:x1876180556940800:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265562.974070:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265562.974078:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d48fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91947e expref: 60 pid: 14174 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.974094:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d48fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91947e expref: 60 pid: 14174 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.974122:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d48fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91947e expref: 60 pid: 14174 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.974142:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:3.0:1789265562.974149:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.974182:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.974190:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.974222:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265562.974296:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+59:2399:x1876180556940800:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 247us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265562.974304:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 100 00010000:00010000:0.0:1789265562.975409:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.975441:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265562.975474:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789265562.975700:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4911 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919485 expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.975721:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919485 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.975731:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:0.0:1789265562.975734:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789265562.975737:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937643218a00, rc 0) 00000100:00100000:0.0:1789265562.975890:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+59:12468:x1876180556940672:12345-192.168.202.42@tcp:101:bash.0 Request processed in 10140us (10415us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789265562.975900:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 223 00000100:00100000:1.0:1789265562.980009:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.980249:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556940928 00000100:00100000:3.0:1789265562.980265:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556940928 00000100:00100000:3.0:1789265562.980349:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 224 00000100:00100000:3.0:1789265562.980360:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+59:12468:x1876180556940928:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1789265562.980394:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265562.980422:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d4926 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91948c expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.980472:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d492d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.980492:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d492d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.980506:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d492d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.980672:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d4926 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91948c expref: 61 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.980709:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d492d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91948c expref: 60 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.980719:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:3.0:1789265562.980722:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789265562.980726:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a4200, rc 0) 00000100:00100000:3.0:1789265562.981062:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+60:12468:x1876180556940928:12345-192.168.202.42@tcp:101:bash.0 Request processed in 701us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265562.981071:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 224 00000100:00100000:2.0:1789265562.985205:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265562.985315:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556941184 00000100:00100000:3.0:1789265562.985330:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556941184 00000100:00100000:3.0:1789265562.985470:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 225 00000100:00100000:3.0:1789265562.985483:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f4d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+60:12468:x1876180556941184:12345-192.168.202.42@tcp:36:bash.0 00010000:00010000:3.0:1789265562.986117:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d4934 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.986143:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d4934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.986156:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d4934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265562.986211:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1789265562.986239:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007170b4a8 reply state 00000000dfaa4e41 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d4934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.986254:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d4934 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265562.986282:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:3.0:1789265562.986285:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265562.986290:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265562.986470:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f4d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+63:12468:x1876180556941184:12345-192.168.202.42@tcp:36:bash.0 Request processed in 988us (1280us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789265562.986479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 225 00000020:00080000:3.0:1789265562.986485:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789265562.992436:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265562.992579:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556941312 00000100:00100000:2.0:1789265562.992593:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556941312 00000100:00100000:2.0:1789265562.992680:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 226 00000100:00100000:2.0:1789265562.992694:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+63:12468:x1876180556941312:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1789265562.992752:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265562.992782:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d493b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919493 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.993148:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.993171:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919485 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.993183:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.993230:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919485 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.993246:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919485 expref: 64 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265562.993264:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579020544:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265562.993382:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377484ce240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265562.997223:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265562.997356:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579020544:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265562.997395:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265562.997479:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556941440 00000100:00100000:1.0:1789265562.997505:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556941440 00010000:00010000:1.0:1789265562.997550:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919485 expref: 65 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265562.997609:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 101 00000100:00100000:1.0:1789265562.997620:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+65:2399:x1876180556941440:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265562.997642:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265562.997659:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919485 expref: 65 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.997673:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919485 expref: 65 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.997702:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4918 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919485 expref: 65 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.997723:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:1.0:1789265562.997729:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.997741:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.997751:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.997785:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265562.997946:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.997955:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265562.998032:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789265562.998047:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265562.998077:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.998120:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d493b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919493 expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.998139:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919493 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265562.998147:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:0.0:1789265562.998150:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265562.998153:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd600, rc 0) 00000100:00100000:1.0:1789265562.998547:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+64:2399:x1876180556941440:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 927us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265562.998578:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 101 00000100:00100000:0.0:1789265563.000678:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+63:12468:x1876180556941312:12345-192.168.202.42@tcp:101:bash.0 Request processed in 7961us (8229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265563.000696:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 226 00000100:00100000:0.0:1789265563.007503:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265563.007607:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556941696 00000100:00100000:1.0:1789265563.007622:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556941696 00000100:00100000:1.0:1789265563.007731:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:1.0:1789265563.007744:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+63:12468:x1876180556941696:12345-192.168.202.42@tcp:35:bash.0 00000100:00080000:3.0:1789265563.008349:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265563.008660:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+64:12468:x1876180556941696:12345-192.168.202.42@tcp:35:bash.0 Request processed in 914us (1168us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789265563.008672:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:2.0:1789265563.092237:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.092440:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556941824 00000100:00100000:3.0:1789265563.092454:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556941824 00000100:00100000:3.0:1789265563.092535:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 227 00000100:00100000:3.0:1789265563.092548:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+64:12474:x1876180556941824:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265563.092581:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265563.092611:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d4949 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91949a expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.092777:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4950 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.092794:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.092809:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265563.093113:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789265563.093118:0:9988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265563.093148:0:9988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.093206:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d4949 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91949a expref: 66 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.093234:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4950 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91949a expref: 65 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.093244:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:3.0:1789265563.093247:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265563.093252:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a5c00, rc 0) 00000100:00100000:3.0:1789265563.093388:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+65:12474:x1876180556941824:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 841us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.093396:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 227 00000100:00100000:2.0:1789265563.097037:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.097129:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556941952 00000100:00100000:3.0:1789265563.097143:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556941952 00000100:00100000:3.0:1789265563.097220:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 228 00000100:00100000:3.0:1789265563.097232:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+65:12474:x1876180556941952:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265563.097261:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265563.097291:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d4957 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9194a1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097378:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d495e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097396:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d495e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097408:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d495e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097439:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4965 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097448:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097455:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097555:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d496c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097565:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d496c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097571:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d496c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265563.097622:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789265563.097627:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265563.097650:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d496c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097677:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d496c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097687:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d495e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097694:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d495e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097712:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d495e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097719:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265563.097723:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d495e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097732:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d495e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097748:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:3.0:1789265563.097752:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265563.097757:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d495e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097764:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d495e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097784:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097790:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4965 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097795:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4965 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097800:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265563.097803:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4965 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097819:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4965 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097828:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575100) 00010000:00010000:3.0:1789265563.097840:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265563.097844:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4965 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097850:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4965 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097933:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d4957 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a1 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097949:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d496c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a1 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.097956:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:3.0:1789265563.097958:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265563.097961:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a5e00, rc 0) 00000100:00100000:3.0:1789265563.098043:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+66:12474:x1876180556941952:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 811us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.098051:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 228 00000100:00100000:0.0:1789265563.102261:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265563.102385:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556942208 00000100:00100000:2.0:1789265563.102399:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556942208 00000100:00100000:2.0:1789265563.102480:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 229 00000100:00100000:2.0:1789265563.102492:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+66:12474:x1876180556942208:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265563.102535:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265563.102562:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4973 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9194a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.102707:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.102725:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919493 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.102734:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d496c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a1 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.102744:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.102786:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d496c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a1 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.102801:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d496c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a1 expref: 67 pid: 6520 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265563.102815:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f580000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579020672:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265563.102985:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919493 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.102995:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919493 expref: 67 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265563.103016:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579020800:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265563.103039:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377484ce240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265563.106323:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f580000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579020672:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265563.106344:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876180579020800:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265563.106385:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265563.108413:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.108743:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556942464 00000100:00100000:3.0:1789265563.108756:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556942464 00010000:00010000:3.0:1789265563.108807:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919493 expref: 68 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265563.108941:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 102 00000100:00100000:3.0:1789265563.108957:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377583da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+68:2397:x1876180556942464:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265563.108977:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265563.108986:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919493 expref: 68 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.109000:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919493 expref: 68 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.109027:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4942 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919493 expref: 68 pid: 6519 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.109050:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:3.0:1789265563.109056:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.109067:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.109073:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265563.109349:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377583da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+67:2397:x1876180556942464:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 396us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.109358:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 102 00000100:00100000:0.0:1789265563.112852:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.113007:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556942592 00000100:00100000:3.0:1789265563.113024:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556942592 00010000:00010000:3.0:1789265563.113091:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d496c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a1 expref: 67 pid: 6520 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265563.113168:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 103 00000100:00100000:3.0:1789265563.113181:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643518a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+67:2399:x1876180556942592:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265563.113204:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265563.113213:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d496c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a1 expref: 67 pid: 6520 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.113232:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d496c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a1 expref: 67 pid: 6520 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.113259:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d496c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a1 expref: 67 pid: 6520 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.113284:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:3.0:1789265563.113290:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.113304:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.113314:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.113356:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265563.113424:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643518a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+66:2399:x1876180556942592:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 245us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.113432:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 103 00010000:00010000:2.0:1789265563.113564:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.113574:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265563.113597:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789265563.113769:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d4973 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a8 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.113789:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a8 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.113798:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:2.0:1789265563.113801:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789265563.113803:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc000, rc 0) 00000100:00100000:2.0:1789265563.113852:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+66:12474:x1876180556942208:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 11362us (11609us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789265563.113897:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 229 00000100:00100000:2.0:1789265563.116219:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265563.116324:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556942336 00000100:00100000:1.0:1789265563.116337:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556942336 00000100:00100000:1.0:1789265563.116423:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:1.0:1789265563.116436:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+66:2398:x1876180556942336:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265563.116457:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265563.116460:0:6505:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie bbfdc9019c1d496c) 00010000:00010000:1.0:1789265563.116463:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265563.116531:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+66:2398:x1876180556942336:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 98us (324us total) trans 0 rc 116/116 00000100:00100000:1.0:1789265563.116540:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:0.0:1789265563.120482:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.120580:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556942848 00000100:00100000:3.0:1789265563.120609:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556942848 00000100:00100000:3.0:1789265563.120689:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:3.0:1789265563.120700:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+66:12474:x1876180556942848:12345-192.168.202.42@tcp:103:lfs.0 00010000:00010000:3.0:1789265563.120718:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265563.120748:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d48cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919477 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.120771:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:3.0:1789265563.120777:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265563.120854:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+65:12474:x1876180556942848:12345-192.168.202.42@tcp:103:lfs.0 Request processed in 156us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.120902:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:0.0:1789265563.127065:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.127167:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556942976 00000100:00100000:3.0:1789265563.127181:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556942976 00000100:00100000:3.0:1789265563.127264:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 230 00000100:00100000:3.0:1789265563.127276:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+65:12474:x1876180556942976:12345-192.168.202.42@tcp:58:lfs.0 00010000:00010000:3.0:1789265563.127430:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d4988 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.127453:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d4988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.127466:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d4988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265563.127614:0:9988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789265563.127720:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+65:12474:x1876180556942976:12345-192.168.202.42@tcp:58:lfs.0 Request processed in 445us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.127729:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 230 00000100:00100000:2.0:1789265563.130351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.130452:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556943104 00000100:00100000:3.0:1789265563.130465:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556943104 00000100:00100000:3.0:1789265563.130542:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 231 00000100:00100000:3.0:1789265563.130554:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+65:12474:x1876180556943104:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265563.130591:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265563.130619:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d498f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9194af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.130701:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d4988 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.130714:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d498f lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194af expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.130737:0:6521:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d4988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.130752:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d498f lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194af expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.130768:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:3.0:1789265563.130771:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265563.130776:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d498f lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194af expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.130784:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a4600, rc 0) 00000100:00100000:2.0:1789265563.131377:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+66:12474:x1876180556943104:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 818us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.131386:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 231 00010000:00010000:3.0:1789265563.187467:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265563.385338:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265563.385354:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265563.385387:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789265563.385402:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265563.385593:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1876180579020928:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789265563.385755:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377600426c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265563.393475:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1876180579020928:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265563.398597:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265563.398918:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556943232 00000100:00100000:2.0:1789265563.398934:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556943232 00000100:00100000:2.0:1789265563.399011:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 232 00000100:00100000:2.0:1789265563.399024:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+66:12476:x1876180556943232:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789265563.399073:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789265563.399247:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+66:12476:x1876180556943232:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 224us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.399256:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 232 00000100:00100000:2.0:1789265563.404745:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.405986:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556943360 00000100:00100000:3.0:1789265563.406005:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556943360 00000100:00100000:3.0:1789265563.406116:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 233 00000100:00100000:3.0:1789265563.406130:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+66:12476:x1876180556943360:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789265563.406411:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d4996 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.406627:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d4996 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.406648:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d4996 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.406682:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d499d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.406691:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d499d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.406698:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d499d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.406732:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.406742:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.406748:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265563.406810:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789265563.406815:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265563.406843:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407079:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d4996 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407089:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d4996 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407097:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d4996 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407104:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4e00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265563.407109:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d4996 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407118:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d4996 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407135:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93774712f300) 00010000:00010000:3.0:1789265563.407137:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265563.407142:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d4996 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407149:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d4996 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407169:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d499d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407175:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d499d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407291:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d499d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407303:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265563.407306:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d499d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407312:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d499d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407322:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff93774e575f00) 00010000:00010000:3.0:1789265563.407324:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265563.407327:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d499d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407332:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d499d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407348:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407354:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407722:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407729:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265563.407732:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407738:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407760:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:3.0:1789265563.407762:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265563.407766:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.407773:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265563.408064:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+66:12476:x1876180556943360:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 Request processed in 1931us (3587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.408077:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 233 00000100:00100000:3.0:1789265563.411187:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265563.411355:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556943616 00000100:00100000:2.0:1789265563.411379:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556943616 00000100:00100000:2.0:1789265563.411600:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 234 00000100:00100000:2.0:1789265563.411616:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+66:12476:x1876180556943616:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265563.411648:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265563.411692:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d49ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9194b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.411856:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.411924:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.411939:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265563.411954:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789265563.412066:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.412074:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.412080:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.412087:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265563.412092:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.412101:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.412116:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:2.0:1789265563.412120:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789265563.412125:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.412132:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.412199:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d49ab lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194b6 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.412219:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93774712f300) 00010000:00010000:2.0:1789265563.412222:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265563.412227:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d49ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194b6 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.412237:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fdc00, rc 0) 00000100:00100000:2.0:1789265563.412327:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+67:12476:x1876180556943616:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 715us (1154us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1789265563.412335:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 234 00000100:00100000:1.0:1789265563.421734:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.422635:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556943744 00000100:00100000:3.0:1789265563.422654:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556943744 00000100:00100000:3.0:1789265563.422751:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 235 00000100:00100000:3.0:1789265563.422764:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+67:12476:x1876180556943744:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265563.422816:0:9988:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265563.423030:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+67:12476:x1876180556943744:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 267us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.423039:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 235 00000100:00100000:1.0:1789265563.433079:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265563.436646:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556944000 00000100:00100000:2.0:1789265563.436674:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556944000 00000100:00100000:2.0:1789265563.436891:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 236 00000100:00100000:2.0:1789265563.436905:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+67:12476:x1876180556944000:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265563.436935:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265563.436939:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789265563.436978:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d4950 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91949a expref: 67 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.437008:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:2.0:1789265563.437015:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265563.437033:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49c0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9194bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265563.437573:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1789265563.437760:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d49c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.437795:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d49c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.437808:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d49c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.437961:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194bd expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.437980:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d49c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194bd expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.437988:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9377522fe200) 00010000:00010000:2.0:1789265563.437990:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265563.437994:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fde00, rc 0) 00000100:00100000:2.0:1789265563.438085:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+68:12476:x1876180556944000:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 1183us (5022us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789265563.438095:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 236 00000100:00100000:2.0:1789265563.445610:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.446679:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556944256 00000100:00100000:3.0:1789265563.446697:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556944256 00000100:00100000:3.0:1789265563.446800:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 237 00000100:00100000:3.0:1789265563.446813:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+68:12476:x1876180556944256:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265563.447372:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265563.447411:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fde00/0xbbfdc9019c1d49c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194bd expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447448:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9377522fe200) 00010000:00010000:3.0:1789265563.447482:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265563.447514:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447530:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447542:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447560:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d49dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xc80abe0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447567:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d49dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc80abe0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447574:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d49dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc80abe0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447636:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447644:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49d5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447652:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447659:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265563.447664:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447673:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447690:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:3.0:1789265563.447693:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265563.447698:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49d5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447704:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d49d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447717:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d49dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc80abe0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447724:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d49dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc80abe0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447729:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d49dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc80abe0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447736:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265563.447738:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d49dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc80abe0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447744:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d49dc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc80abe0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447751:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xc80abe0a (ffff93774e575f00) 00010000:00010000:3.0:1789265563.447753:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265563.447756:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d49dc lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc80abe0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.447760:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d49dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc80abe0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265563.448165:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+67:12476:x1876180556944256:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 1350us (2567us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265563.448174:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 237 00000100:00100000:1.0:1789265563.453135:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.453240:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556944384 00000100:00100000:3.0:1789265563.453255:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556944384 00000100:00100000:3.0:1789265563.453333:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 238 00000100:00100000:3.0:1789265563.453347:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+67:12476:x1876180556944384:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265563.453390:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265563.453422:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d49e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9194c4 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.453729:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d49ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.453748:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d49ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.453763:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d49ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.453985:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d49e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194c4 expref: 69 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.454010:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d49ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194c4 expref: 68 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.454020:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93774e575600) 00010000:00010000:3.0:1789265563.454031:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789265563.454036:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a5c00, rc 0) 00000100:00100000:3.0:1789265563.454114:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+68:12476:x1876180556944384:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 768us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.454838:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 238 00000100:00100000:1.0:1789265563.464166:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265563.471122:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556944640 00000100:00100000:2.0:1789265563.471147:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556944640 00000100:00100000:2.0:1789265563.471332:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 239 00000100:00100000:2.0:1789265563.471347:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+68:12476:x1876180556944640:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265563.471596:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.471620:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.471664:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265563.471963:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1789265563.471976:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 419133115796ns, next at 420133112266ns, rc = 0 00000004:00010000:2.0:1789265563.472049:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8725b20 reply state 00000000ff617da9 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.472066:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.472074:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93774e575600) 00010000:00010000:2.0:1789265563.472077:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789265563.472081:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265563.472239:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+70:12476:x1876180556944640:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 893us (8086us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789265563.472248:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 239 00000100:00100000:0.0:1789265563.478750:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.479019:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556944768 00000100:00100000:3.0:1789265563.479033:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556944768 00000100:00100000:3.0:1789265563.479107:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 240 00000100:00100000:3.0:1789265563.479117:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+70:12476:x1876180556944768:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265563.479151:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265563.479177:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d49f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9194cb expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.479253:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d49f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194cb expref: 71 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.479271:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d49f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194cb expref: 71 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.479295:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93774e575600) 00010000:00010000:3.0:1789265563.479298:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265563.479303:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a4e00, rc 0) 00000100:00100000:3.0:1789265563.480604:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+71:12476:x1876180556944768:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 1476us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.480616:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 240 00000100:00100000:1.0:1789265563.494138:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.498552:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556944896 00000100:00100000:3.0:1789265563.498586:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556944896 00000100:00100000:3.0:1789265563.498734:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:3.0:1789265563.498754:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2399:x1876180556944896:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789265563.499129:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265563.512302:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+10:2399:x1876180556944896:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 13538us (18161us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789265563.512322:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:1.0:1789265563.528551:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265563.528652:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556945152 00000100:00100000:2.0:1789265563.528667:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556945152 00000100:00100000:2.0:1789265563.528796:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:2.0:1789265563.528812:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+71:12476:x1876180556945152:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789265563.529226:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+72:12476:x1876180556945152:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 417us (691us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1789265563.529235:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:2.0:1789265563.531263:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.531377:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556945408 00000100:00100000:3.0:1789265563.531390:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556945408 00000100:00100000:3.0:1789265563.531468:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 241 00000100:00100000:3.0:1789265563.531490:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+72:12476:x1876180556945408:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789265563.531655:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+72:12476:x1876180556945408:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 167us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.531665:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 241 00000100:00100000:0.0:1789265563.535047:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.535230:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556945536 00000100:00100000:3.0:1789265563.535243:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556945536 00000100:00100000:3.0:1789265563.535328:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 242 00000100:00100000:3.0:1789265563.535343:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+72:12476:x1876180556945536:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265563.535383:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265563.535413:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d49ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9194d2 expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.535670:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.535690:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.535704:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265563.535767:0:9988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265563.535796:0:9988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.536898:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d49ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194d2 expref: 74 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.536949:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194d2 expref: 73 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.536960:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93774e575600) 00010000:00010000:3.0:1789265563.536963:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789265563.536968:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a5600, rc 0) 00000100:00100000:2.0:1789265563.537223:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+73:12476:x1876180556945536:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 1880us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.537252:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 242 00000100:00100000:2.0:1789265563.539951:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265563.540181:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556945664 00000100:00100000:1.0:1789265563.540196:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556945664 00000100:00100000:1.0:1789265563.540275:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:1.0:1789265563.540288:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+10:2399:x1876180556945664:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265563.540312:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265563.540339:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a0d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9194d9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265563.540371:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa6069c, blocks: 0x0 00010000:00010000:1.0:1789265563.540399:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=419s v=(0 0) 00010000:00010000:1.0:1789265563.540404:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265563.540415:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194d9 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.540437:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194d9 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.540454:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bcc00, rc 0) 00000100:00100000:1.0:1789265563.540618:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+11:2399:x1876180556945664:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 333us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265563.540656:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:0.0:1789265563.544185:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265563.544241:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556945920 00000100:00100000:2.0:1789265563.544257:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556945920 00000100:00100000:2.0:1789265563.544370:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 243 00000100:00100000:2.0:1789265563.544381:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+73:12476:x1876180556945920:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265563.544536:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+73:12476:x1876180556945920:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 156us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.544544:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 243 00000100:00100000:2.0:1789265563.547726:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265563.547976:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556946048 00000100:00100000:1.0:1789265563.547992:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556946048 00000100:00100000:1.0:1789265563.548075:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 72 00000100:00100000:1.0:1789265563.548088:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+11:12476:x1876180556946048:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265563.548112:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265563.548137:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c075262/0xbbfdc9019c1d4a14 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9194e0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.548175:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a0d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194d9 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.548184:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265563.548189:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265563.548194:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c075262/0xbbfdc9019c1d4a14 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e0 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.548238:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194d9 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.548254:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194d9 expref: 12 pid: 8436 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265563.548271:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1876180579021056:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265563.548397:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377600426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265563.551400:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1876180579021056:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265563.551452:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005c075262/0xbbfdc9019c1d4a14 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e0 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.551492:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd800, rc 0) 00000100:00100000:0.0:1789265563.551569:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+12:12476:x1876180556946048:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 3482us (3857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265563.551579:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 72 00000100:00100000:2.0:1789265563.554319:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265563.554459:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556946176 00000100:00100000:1.0:1789265563.554474:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556946176 00010000:00010000:1.0:1789265563.554527:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194d9 expref: 12 pid: 8436 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265563.554578:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 104 00000100:00100000:1.0:1789265563.554589:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+12:2400:x1876180556946176:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265563.554606:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265563.554637:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194d9 expref: 12 pid: 8436 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.554772:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194d9 expref: 12 pid: 8436 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.554804:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a0d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194d9 expref: 12 pid: 8436 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.554843:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265563.554849:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265563.554978:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005c075262/0xbbfdc9019c1d4a14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e0 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.554991:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c075262/0xbbfdc9019c1d4a14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e0 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.555048:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005c075262/0xbbfdc9019c1d4a14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e0 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265563.555091:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1876180579021184:192.168.202.42@tcp:105: 00000100:00100000:1.0:1789265563.556500:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265563.564266:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265563.564369:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556946304 00000100:00100000:2.0:1789265563.564384:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556946304 00002000:00100000:2.0:1789265563.564456:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff937643519500 x1876180556946304/t0(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:134/0 lens 504/0 e 0 to 0 dl 1789265574 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789265563.564469:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff937643519500 with x1876180556946304 ext(0->12) 00002000:00010000:2.0:1789265563.564476:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff937643519500 00000100:00100000:2.0:1789265563.564516:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:2.0:1789265563.564529:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+12:2400:x1876180556946304:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789265563.565516:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1876180579021184:192.168.202.42@tcp:105: 00010000:00010000:1.0:1789265563.565548:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265563.565881:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+14:2400:x1876180556946304:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 Request processed in 1353us (1630us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789265563.565892:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:0.0:1789265563.565894:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+14:2400:x1876180556946176:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 11307us (11595us total) trans 0 rc 0/0 00002000:00100000:2.0:1789265563.565902:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff937643519500 x1876180556946304/t4294967321(0) o4->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:134/0 lens 504/448 e 0 to 0 dl 1789265574 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1789265563.565903:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 104 00002000:00100000:2.0:1789265563.565927:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff937643519500 with x1876180556946304 ext(0->12) 00002000:00010000:2.0:1789265563.565932:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff937643519500 00000100:00100000:0.0:1789265563.568900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265563.569057:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556946432 00000100:00100000:1.0:1789265563.569073:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556946432 00000100:00100000:1.0:1789265563.569156:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 244 00000100:00100000:1.0:1789265563.569169:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+73:12476:x1876180556946432:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789265563.571216:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1789265563.571239:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1789265563.571288:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789265563.571311:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff937744664840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789265563.571317:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93774f178200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff937744664a80 00000020:00080000:0.0:1789265563.571321:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93774f178e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff937761198c00 00000004:00080000:0.0:1789265563.571352:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1789265563.571383:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9377461bb000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789265563.571386:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff937643c14200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9377461bb300 00000020:00080000:0.0:1789265563.571389:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff937643c14100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9377613ccc00 00000020:00080000:0.0:1789265563.571445:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789265563.571529:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789265563.571666:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579021440:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789265563.571764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265563.571840:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265563.571848:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579021312:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789265563.571891:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579021440 00000100:00100000:3.0:1789265563.571897:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265563.571903:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579021440 00000100:00100000:3.0:1789265563.571926:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579021568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789265563.571949:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265563.572223:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579021312 00000100:00100000:2.0:1789265563.572229:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579021312 00000100:00100000:2.0:1789265563.572271:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579021568 00010000:00010000:1.0:1789265563.572273:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4719 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265563.572274:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579021568 00010000:00010000:1.0:1789265563.572287:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4719 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265563.572290:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00010000:00010000:1.0:1789265563.572296:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4719 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265563.572300:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3646:x1876180579021440:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789265563.572303:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bda00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265563.572309:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4719 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572318:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4719 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789265563.572333:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1789265563.572340:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff937779d97000) 00010000:00010000:1.0:1789265563.572342:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265563.572348:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4719 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572368:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bda00/0xbbfdc9019c1d4719 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265563.572377:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa6069b, atime: 0x6aa6069b, ctime: 0x6aa6069b, blocks: 0x8 00010000:00010000:2.0:1789265563.572384:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4a1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.572400:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=419s v=(0 0) 00010000:00010000:1.0:1789265563.572402:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d47c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.572405:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265563.572408:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d47c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572413:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d47c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.572414:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4a1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572418:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5a00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265563.572421:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d47c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572427:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d47c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572436:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93774e575a00) 00010000:00010000:1.0:1789265563.572439:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265563.572442:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d47c1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572447:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5a00/0xbbfdc9019c1d47c1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572466:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d483f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572472:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d483f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572485:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d483f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572491:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265563.572494:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d483f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572501:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d483f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572510:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575100) 00010000:00010000:1.0:1789265563.572512:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265563.572515:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d483f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572520:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4000/0xbbfdc9019c1d483f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572535:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4862 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572541:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4862 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572547:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4862 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572551:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265563.572554:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4862 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572570:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4862 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572578:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93774e575100) 00010000:00010000:1.0:1789265563.572580:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265563.572582:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4862 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572588:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4862 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572605:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d4934 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572611:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d4934 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572616:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d4934 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572620:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265563.572622:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d4934 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572629:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d4934 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.572640:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:2.0:1789265563.572919:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4a1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.572932:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4a1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.572940:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4a1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.572967:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1789265563.572982:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789265563.573113:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265563.573118:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d4934 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.573134:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5400/0xbbfdc9019c1d4934 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.573154:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.573161:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.573167:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.573172:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265563.573175:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.573181:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.573192:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93774e575600) 00010000:00010000:1.0:1789265563.573195:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789265563.573198:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49f1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.573204:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd400/0xbbfdc9019c1d49f1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265563.573238:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265563.573251:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1876180579021312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789265563.573274:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1789265563.573300:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.573318:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074c52a58/0xbbfdc9019c1d47cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919438 expref: 12 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.573326:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789265563.573329:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789265563.573333:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a22 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.573372:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074c52a58/0xbbfdc9019c1d47cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919438 expref: 12 pid: 9789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.573390:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074c52a58/0xbbfdc9019c1d47cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919438 expref: 12 pid: 9789 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265563.573406:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1876180579021696:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265563.573503:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265563.574098:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3646:x1876180579021440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1796us (2331us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789265563.574108:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789265563.574136:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789265563.574144:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3643:x1876180579021568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789265563.574335:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789265563.574339:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789265564 00002000:00010000:2.0:1789265563.574341:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789265563.574343:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789265564 -> 1789265564 00002000:00010000:2.0:1789265563.574345:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789265563.574384:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3643:x1876180579021568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 241us (2433us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789265563.574390:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1789265563.574414:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265563.574424:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4a1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.574446:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:2.0:1789265563.574451:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4a1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.574462:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4a1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.574498:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4a1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.574505:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4a1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.574529:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265563.574531:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265563.574533:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265563.575769:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+21:12476:x1876180556946432:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 Request processed in 6590us (6954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265563.575783:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 244 00000004:00080000:1.0:1789265563.575991:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9376435aad80/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789265563.576000:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579021440:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789265563.578691:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93777f583480/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789265563.578712:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579021568:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1789265563.581270:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1789265563.581294:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1789265563.582316:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1876180579021696:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265563.582358:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265563.583143:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.583438:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556946560 00000100:00100000:3.0:1789265563.583449:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556946560 00000100:00100000:3.0:1789265563.583519:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 76 00000100:00100000:3.0:1789265563.583530:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+13:2398:x1876180556946560:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789265563.586014:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1789265563.586034:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1789265563.586349:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2398:x1876180556946560:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 Request processed in 2803us (3194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.586395:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 76 00000100:00100000:0.0:1789265563.589286:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.593083:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556946688 00000100:00100000:3.0:1789265563.593116:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556946688 00010000:00010000:3.0:1789265563.593239:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074c52a58/0xbbfdc9019c1d47cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919438 expref: 8 pid: 9789 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265563.593294:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 105 00000100:00100000:3.0:1789265563.593320:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2400:x1876180556946688:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265563.593357:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265563.593386:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074c52a58/0xbbfdc9019c1d47cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919438 expref: 8 pid: 9789 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.593412:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074c52a58/0xbbfdc9019c1d47cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919438 expref: 8 pid: 9789 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.593451:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074c52a58/0xbbfdc9019c1d47cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919438 expref: 8 pid: 9789 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.593503:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265563.593509:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265563.593536:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.593549:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a22 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.593808:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789265563.594293:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.594306:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.594335:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.594343:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.594380:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789265563.594641:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876180579021312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21391us (22738us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789265563.594666:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1789265563.594988:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265563.594998:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.595008:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bcc00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265563.595013:0:13735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.595025:0:13735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.595044:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a22 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.595052:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b76eb863/0xbbfdc9019c1d4a22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.595079:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265563.595081:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265563.595083:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265563.595134:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1789265563.595141:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1789265563.595170:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93777f583480, transno 4294967322 00000100:00100000:1.0:1789265563.595216:0:3646:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff93777f581c00 x1876180579021312/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789265579 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789265563.595231:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93777f581c00/2, rc 0, transno 4294967323 00000100:00100000:1.0:1789265563.595237:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579021312:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789265563.595544:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2400:x1876180556946688:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 2222us (6265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.595555:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 105 00000100:00100000:2.0:1789265563.596163:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.597349:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556946944 00000100:00100000:3.0:1789265563.597365:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556946944 00000100:00100000:3.0:1789265563.597633:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 245 00000100:00100000:3.0:1789265563.597765:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+21:12476:x1876180556946944:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265563.597967:0:9988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265563.598005:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194d2 expref: 21 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.598033:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93774e575600) 00010000:00010000:3.0:1789265563.598040:0:9988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265563.598083:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4a29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.598101:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4a29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.598113:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4a29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265563.598272:0:9988:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000428d20c6 reply state 000000009b0adf07 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4a29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.598287:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4a29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.598315:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93774e575600) 00010000:00010000:3.0:1789265563.598318:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265563.598320:0:9988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265563.598553:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+22:12476:x1876180556946944:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 908us (2391us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1789265563.598562:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 245 00000100:00100000:2.0:1789265563.601939:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265563.602044:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556947072 00000100:00100000:0.0:1789265563.602057:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556947072 00000100:00100000:0.0:1789265563.602134:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 77 00000100:00100000:0.0:1789265563.602147:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556947072:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789265563.602346:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789265563.602350:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789265564 -> 1789265564 00002000:00010000:0.0:1789265563.602353:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789265563 00002000:00010000:0.0:1789265563.602355:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789265564 -> 1789265564 00002000:00010000:0.0:1789265563.602374:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789265563.602450:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2399:x1876180556947072:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 305us (524us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789265563.602458:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 77 00000100:00100000:2.0:1789265563.604944:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265563.605059:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556947328 00000100:00100000:0.0:1789265563.605072:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556947328 00000100:00100000:0.0:1789265563.605143:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 246 00000100:00100000:0.0:1789265563.605155:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+22:12476:x1876180556947328:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789265563.605253:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.605274:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d49ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194c4 expref: 22 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.605285:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.605327:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d49ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194c4 expref: 22 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.605355:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d49ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194c4 expref: 22 pid: 14174 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265563.605372:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643518380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876180579021824:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265563.605468:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775235ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265563.609598:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.609705:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556947456 00000100:00100000:3.0:1789265563.609719:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556947456 00010000:00010000:3.0:1789265563.609775:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d49ea lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194c4 expref: 23 pid: 14174 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265563.609850:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 106 00000100:00100000:3.0:1789265563.609900:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+23:2400:x1876180556947456:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265563.609920:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265563.609930:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d49ea lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194c4 expref: 23 pid: 14174 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.609947:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d49ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194c4 expref: 23 pid: 14174 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.609977:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93774e575600) 00010000:00010000:3.0:1789265563.609984:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.609997:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.610022:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.610050:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265563.610119:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+23:2400:x1876180556947456:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 258us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.610127:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 106 00010000:00010000:0.0:1789265563.610675:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5c00/0xbbfdc9019c1d49ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194c4 expref: 22 pid: 14174 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265563.610717:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643518380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876180579021824:192.168.202.42@tcp:104: 00010000:00010000:0.0:1789265563.610744:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.610754:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.610760:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.610834:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.610843:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.610851:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.610916:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643219a00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265563.610923:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.610933:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.610947:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93774e575600) 00010000:00010000:0.0:1789265563.610950:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789265563.610955:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.610968:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a30 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265563.611046:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+21:12476:x1876180556947328:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 Request processed in 5892us (6116us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789265563.611056:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 246 00000100:00100000:1.0:1789265563.614806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.615164:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556947584 00000100:00100000:3.0:1789265563.615182:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556947584 00000100:00100000:3.0:1789265563.615704:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 78 00000100:00100000:3.0:1789265563.615721:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2400:x1876180556947584:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789265563.615786:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000053decaa6/0xbbfdc9019c1d4a37 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.615813:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c075262/0xbbfdc9019c1d4a14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e0 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.615840:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265563.615845:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265563.615851:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053decaa6/0xbbfdc9019c1d4a37 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.615925:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c075262/0xbbfdc9019c1d4a14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e0 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.615942:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c075262/0xbbfdc9019c1d4a14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e0 expref: 8 pid: 8435 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265563.615979:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1876180579021952:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265563.616107:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744664c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265563.620005:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265563.620200:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556947712 00000100:00100000:0.0:1789265563.620213:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556947712 00010000:00010000:0.0:1789265563.620272:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c075262/0xbbfdc9019c1d4a14 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e0 expref: 9 pid: 8435 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265563.620329:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 107 00000100:00100000:0.0:1789265563.620341:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377583d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2399:x1876180556947712:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265563.620360:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265563.620389:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c075262/0xbbfdc9019c1d4a14 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e0 expref: 9 pid: 8435 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.620406:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c075262/0xbbfdc9019c1d4a14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e0 expref: 9 pid: 8435 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.620441:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265563.620447:0:7460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789265563.620453:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053decaa6/0xbbfdc9019c1d4a37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.620465:0:7460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053decaa6/0xbbfdc9019c1d4a37 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.620510:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265563.620590:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377583d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+9:2399:x1876180556947712:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 251us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265563.620599:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 107 00010000:00010000:3.0:1789265563.621146:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c075262/0xbbfdc9019c1d4a14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e0 expref: 8 pid: 8435 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265563.621167:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1876180579021952:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265563.621192:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000053decaa6/0xbbfdc9019c1d4a37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.621204:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000053decaa6/0xbbfdc9019c1d4a37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.621210:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053decaa6/0xbbfdc9019c1d4a37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.621236:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000053decaa6/0xbbfdc9019c1d4a37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.621246:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053decaa6/0xbbfdc9019c1d4a37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.621254:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053decaa6/0xbbfdc9019c1d4a37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.621275:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4400 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265563.621280:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053decaa6/0xbbfdc9019c1d4a37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.621289:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053decaa6/0xbbfdc9019c1d4a37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.621305:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053decaa6/0xbbfdc9019c1d4a37 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.621312:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053decaa6/0xbbfdc9019c1d4a37 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265563.621392:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2400:x1876180556947584:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 Request processed in 5676us (6605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.621403:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 78 00000100:00100000:1.0:1789265563.624554:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265563.624754:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556947968 00000100:00100000:2.0:1789265563.624769:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556947968 00000100:00100000:2.0:1789265563.624895:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 247 00000100:00100000:2.0:1789265563.624908:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+21:12476:x1876180556947968:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789265563.625017:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.625037:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d492d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91948c expref: 21 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.625048:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.625108:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d492d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91948c expref: 21 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.625121:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d492d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91948c expref: 21 pid: 9988 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265563.625133:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579022080:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265563.625235:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265563.629857:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.630156:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556948096 00000100:00100000:3.0:1789265563.630171:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556948096 00010000:00010000:3.0:1789265563.630228:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d492d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91948c expref: 22 pid: 9988 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265563.630281:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 108 00000100:00100000:3.0:1789265563.630293:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+22:2400:x1876180556948096:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265563.630314:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265563.630344:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d492d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91948c expref: 22 pid: 9988 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.630358:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d492d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91948c expref: 22 pid: 9988 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.630389:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:3.0:1789265563.630394:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d498f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194af expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.630405:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.630413:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.630420:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.630456:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265563.630643:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4200/0xbbfdc9019c1d492d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91948c expref: 22 pid: 9988 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265563.630666:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579022080:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265563.630695:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.630706:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.630711:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.631009:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.631026:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d49f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194cb expref: 22 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.631035:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.631095:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d49f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194cb expref: 22 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.631113:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d49f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194cb expref: 22 pid: 9988 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265563.631129:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579022208:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265563.631456:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+22:2400:x1876180556948096:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 1162us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.631467:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 108 00000100:00100000:1.0:1789265563.631586:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265563.635403:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579022592:0@lo:400:kworker.0 00000100:00100000:3.0:1789265563.635506:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265563.635548:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180579023104:0@lo:400:kworker.0 00000100:00100000:3.0:1789265563.635585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265563.635602:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579023616:0@lo:400:kworker.0 00000100:00100000:1.0:1789265563.635736:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180579022720:0@lo:400:kworker.0 00000100:00100000:1.0:1789265563.635768:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265563.635786:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579023232:0@lo:400:kworker.0 00000100:00100000:1.0:1789265563.635808:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265563.635853:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789265563.635899:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180579022336:0@lo:400:kworker.0 00000100:00100000:1.0:1789265563.635934:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265563.635960:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579022848:0@lo:400:kworker.0 00000100:00100000:1.0:1789265563.635980:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265563.635995:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180579023360:0@lo:400:kworker.0 00000100:00100000:1.0:1789265563.636017:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265563.636161:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579022464:0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.636194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265563.636229:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180579022976:0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.636251:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265563.636261:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180579023488:0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.636279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265563.636313:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579022336 00000100:00100000:2.0:1789265563.636322:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579022336 00000100:00100000:2.0:1789265563.636379:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1789265563.636389:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3643:x1876180579022336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.636450:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3643:x1876180579022336:12345-0@lo:400:kworker.0 Request processed in 62us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.636458:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1789265563.636496:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579022592 00000100:00100000:2.0:1789265563.636500:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579022592 00000100:00100000:2.0:1789265563.636525:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579022848 00000100:00100000:2.0:1789265563.636539:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579022848 00000100:00100000:2.0:1789265563.636561:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789265563.636583:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579022592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.636621:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579022592:12345-0@lo:400:kworker.0 Request processed in 39us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.636628:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789265563.636640:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789265563.636657:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579022848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.636686:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579022848:12345-0@lo:400:kworker.0 Request processed in 40us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.636691:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789265563.636710:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579023104 00000100:00100000:2.0:1789265563.636714:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579023104 00000100:00100000:2.0:1789265563.636748:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579022720 00000100:00100000:2.0:1789265563.636750:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579022720 00000100:00100000:2.0:1789265563.636761:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579023360 00000100:00100000:2.0:1789265563.636763:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579023360 00000100:00100000:2.0:1789265563.636776:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579022464 00000100:00100000:2.0:1789265563.636779:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579022464 00000100:00100000:2.0:1789265563.636790:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579022976 00000100:00100000:2.0:1789265563.636792:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579022976 00000100:00100000:2.0:1789265563.636804:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579023488 00000100:00100000:2.0:1789265563.636807:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579023488 00000100:00100000:2.0:1789265563.636838:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789265563.636846:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180579023104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.636907:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180579023104:12345-0@lo:400:kworker.0 Request processed in 62us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.636913:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789265563.636926:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789265563.636942:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180579022720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.636970:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180579022720:12345-0@lo:400:kworker.0 Request processed in 31us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.636975:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789265563.636986:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789265563.636991:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180579023360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.637015:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180579023360:12345-0@lo:400:kworker.0 Request processed in 24us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.637021:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789265563.637031:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789265563.637037:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579022464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.637069:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579022464:12345-0@lo:400:kworker.0 Request processed in 32us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.637075:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789265563.637085:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789265563.637091:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180579022976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.637117:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180579022976:12345-0@lo:400:kworker.0 Request processed in 26us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.637123:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789265563.637134:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789265563.637140:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180579023488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.637168:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180579023488:12345-0@lo:400:kworker.0 Request processed in 29us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.637174:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789265563.637220:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579022464:0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.637241:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180579022976:0@lo:400:kworker.0 00010000:00080000:2.0:1789265563.637255:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93775dc26d80 x1876180579023488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265563.637265:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180579023488:0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.637311:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180579022336:0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.637321:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579022848:0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.637330:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180579023360:0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.637340:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180579022720:0@lo:400:kworker.0 00000100:00100000:3.0:1789265563.637971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265563.638025:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579022592:0@lo:400:kworker.0 00010000:00080000:3.0:1789265563.638040:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435aa680 x1876180579023104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265563.638050:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180579023104:0@lo:400:kworker.0 00000100:00080000:3.0:1789265563.638093:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265563.638098:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265563.638151:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579023232 00000100:00100000:1.0:1789265563.638157:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579023232 00000100:00100000:1.0:1789265563.638209:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579023616 00000100:00100000:1.0:1789265563.638211:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579023616 00000100:00100000:1.0:1789265563.638230:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789265563.638237:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579023232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265563.638298:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579023232:12345-0@lo:400:kworker.0 Request processed in 61us (2489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265563.638305:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789265563.638319:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789265563.638324:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579023616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265563.638347:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579023616:12345-0@lo:400:kworker.0 Request processed in 23us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265563.638352:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1789265563.638528:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265563.638531:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265563.638551:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579023616:0@lo:400:kworker.0 00000100:00100000:2.0:1789265563.638987:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579023232:0@lo:400:kworker.0 00000100:00100000:1.0:1789265563.640091:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265563.640175:0:7460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556948224 00000100:00100000:0.0:1789265563.640184:0:7460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556948224 00010000:00010000:0.0:1789265563.640226:0:7460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d49f8 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194cb expref: 22 pid: 9988 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265563.640269:0:7460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 109 00000100:00100000:0.0:1789265563.640278:0:7460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+22:2399:x1876180556948224:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265563.640294:0:7460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265563.640302:0:7460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d49f8 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194cb expref: 22 pid: 9988 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.640318:0:7460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d49f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194cb expref: 22 pid: 9988 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.640346:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93774e575600) 00010000:00010000:0.0:1789265563.640352:0:7460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.640364:0:7460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.640372:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.640411:0:7460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265563.640788:0:7460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+22:2399:x1876180556948224:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 508us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265563.640798:0:7460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 109 00010000:00010000:2.0:1789265563.640995:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4e00/0xbbfdc9019c1d49f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194cb expref: 21 pid: 9988 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265563.641021:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579022208:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265563.641052:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.641063:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.641069:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265563.641216:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1789265563.641363:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1789265563.641423:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1789265563.641537:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876180579023744:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789265563.641621:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265563.641679:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265563.642369:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579023744 00000100:00100000:3.0:1789265563.642383:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579023744 00000100:00100000:3.0:1789265563.642470:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789265563.642483:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1876180579023744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789265563.642675:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1876180579023744:12345-0@lo:1000:mdt00_002.0 Request processed in 195us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265563.642684:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789265563.643242:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876180579023744:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789265563.643446:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1789265563.643542:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643518a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876180579023872:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789265563.644028:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265563.644063:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265563.644204:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579023872 00000100:00100000:3.0:1789265563.644213:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579023872 00000100:00100000:3.0:1789265563.644308:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789265563.644318:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6521:x1876180579023872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789265563.644510:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6521:x1876180579023872:12345-0@lo:1000:mdt00_002.0 Request processed in 192us (482us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789265563.644518:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789265563.644610:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643518a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876180579023872:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789265563.644678:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644692:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644701:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644707:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265563.644713:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644723:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644744:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93774e575600) 00010000:00010000:0.0:1789265563.644747:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265563.644772:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644779:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd400/0xbbfdc9019c1d4a45 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644816:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d4988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644840:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d4988 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644847:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d4988 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644853:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5e00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265563.644857:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d4988 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644896:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d4988 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644906:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:0.0:1789265563.644909:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265563.644918:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d498f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194af expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644932:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d498f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194af expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644942:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d498f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194af expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.644987:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d498f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194af expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265563.645001:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764351a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579024000:192.168.202.42@tcp:105: 00000100:00100000:0.0:1789265563.645071:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e610780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265563.652703:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.653033:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556948352 00000100:00100000:3.0:1789265563.653046:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556948352 00000100:00100000:1.0:1789265563.653249:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764351a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876180579024000:192.168.202.42@tcp:105: 00010000:00010000:1.0:1789265563.653284:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d4988 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653298:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5e00/0xbbfdc9019c1d4988 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653347:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d4a4c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653366:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d4a4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653380:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d4a4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653390:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d4a4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653396:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d4a4c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653410:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d4a4c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653416:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265563.653420:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d4a4c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653428:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d4a4c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653443:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:1.0:1789265563.653447:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265563.653451:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d4a4c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653457:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d4a4c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653468:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653474:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653480:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653485:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265563.653488:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653506:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653516:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:1.0:1789265563.653518:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265563.653522:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265563.653527:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd800/0xbbfdc9019c1d4a3e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265563.653789:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265563.653795:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265563.654327:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789265563.654343:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789265563.654503:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+25:12476:x1876180556947968:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 29592us (29959us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789265563.654516:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 247 00000020:00080000:1.0:1789265563.654525:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789265563.656662:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:2.0:1789265563.656689:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+24:12474:x1876180556948352:12345-192.168.202.42@tcp:49:lfs.0 00000100:00100000:2.0:1789265563.656908:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+24:12474:x1876180556948352:12345-192.168.202.42@tcp:49:lfs.0 Request processed in 232us (4222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.656916:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:1.0:1789265563.661544:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265563.661664:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556948608 00000100:00100000:2.0:1789265563.661679:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556948608 00000100:00100000:2.0:1789265563.661758:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 248 00000100:00100000:2.0:1789265563.661772:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+24:12474:x1876180556948608:12345-192.168.202.42@tcp:58:lfs.0 00000040:00080000:2.0:1789265563.662277:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789265563.662434:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+24:12474:x1876180556948608:12345-192.168.202.42@tcp:58:lfs.0 Request processed in 663us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.662444:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 248 00000100:00100000:1.0:1789265563.668950:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265563.669102:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556948864 00000100:00100000:2.0:1789265563.669119:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556948864 00000100:00100000:2.0:1789265563.669200:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:2.0:1789265563.669213:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f4ef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+24:12476:x1876180556948864:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789265563.669673:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789265563.669739:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1789265563.669797:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4a53 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.669834:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4a53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.669916:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4a53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.669927:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4a53 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.669934:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4a53 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.669941:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4a53 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.669957:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789265563.670084:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f4ef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+26:12476:x1876180556948864:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 871us (1149us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789265563.670094:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 62 00000020:00080000:2.0:1789265563.670101:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789265563.671305:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265563.671321:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4a53 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.671334:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265563.671339:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4a53 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.671349:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4a53 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.671371:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93774e575600) 00010000:00010000:3.0:1789265563.671374:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789265563.671380:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4a53 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.671385:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd600/0xbbfdc9019c1d4a53 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265563.671409:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265563.671411:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265563.671412:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265563.692686:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265563.693296:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556948992 00000100:00100000:3.0:1789265563.693315:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556948992 00000100:00100000:0.0:1789265563.693640:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 249 00000100:00100000:0.0:1789265563.693662:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+26:12478:x1876180556948992:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1789265563.693700:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265563.693731:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4a5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9194e7 expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.693919:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4a61 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.693940:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4a61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.693957:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4a61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.693977:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.693985:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.693992:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.694124:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4a6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.694138:0:9988:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a8 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.694147:0:9988:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4a6f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.694193:0:9988:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a8 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.694209:0:9988:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a8 expref: 27 pid: 6519 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265563.694225:0:9988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643518380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9988:1876180579024128:192.168.202.42@tcp:104: 00000100:00100000:0.0:1789265563.694405:0:9988:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e610c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265563.698061:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265563.698140:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556949248 00000100:00100000:2.0:1789265563.698153:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556949248 00000100:00100000:2.0:1789265563.698230:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:2.0:1789265563.698242:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+28:10785:x1876180556949248:12345-192.168.202.42@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789265563.698975:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+29:10785:x1876180556949248:12345-192.168.202.42@tcp:35:ldlm_bl.0 Request processed in 730us (923us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789265563.698986:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:3.0:1789265563.699232:0:9988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643518380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9988:1876180579024128:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265563.699268:0:9988:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4a6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265563.701417:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265563.701588:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556949376 00000100:00100000:2.0:1789265563.701602:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556949376 00010000:00010000:2.0:1789265563.701717:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a8 expref: 29 pid: 6519 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265563.701922:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 110 00000100:00100000:2.0:1789265563.701936:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+29:2399:x1876180556949376:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265563.701960:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265563.701969:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a8 expref: 29 pid: 6519 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.701984:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a8 expref: 29 pid: 6519 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.702012:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc000/0xbbfdc9019c1d497a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194a8 expref: 29 pid: 6519 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.702032:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:2.0:1789265563.702039:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4a6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.702049:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4a6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.702058:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4a6f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265563.702095:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265563.702262:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+28:2399:x1876180556949376:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 327us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265563.702271:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 110 00010000:00010000:0.0:1789265563.702347:0:9988:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4a6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702356:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4a6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265563.702434:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789265563.702441:0:9988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265563.702469:0:9988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4a6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702500:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4a6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702512:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4a61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702519:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4a61 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702526:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4a61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702531:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643218a00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265563.702537:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4a61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702545:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4a61 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702556:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:0.0:1789265563.702559:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265563.702563:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4a61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702570:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218a00/0xbbfdc9019c1d4a61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702582:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702588:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702601:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702606:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643219a00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265563.702609:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702616:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702625:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff937782161700) 00010000:00010000:0.0:1789265563.702629:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265563.702632:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a68 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.702637:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643219a00/0xbbfdc9019c1d4a68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.703689:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937643218200/0xbbfdc9019c1d4a5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e7 expref: 28 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.703715:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4a6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e7 expref: 27 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265563.703724:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:0.0:1789265563.703726:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265563.703729:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393c00, rc 0) 00000100:00100000:0.0:1789265563.703803:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+27:12478:x1876180556948992:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 10151us (11131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265563.704099:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 249 00000100:00100000:0.0:1789265564.154072:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265564.154163:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579024256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265564.154244:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265564.154321:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579024256 00000100:00100000:0.0:1789265564.154330:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579024256 00000100:00100000:0.0:1789265564.154378:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789265564.154385:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579024256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265564.154409:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1789265564.154446:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579024256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265564.154451:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789265564.154501:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579024256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265564.155483:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579024384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265564.155538:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265564.155587:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579024384 00000100:00100000:1.0:1789265564.155591:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579024384 00000100:00100000:1.0:1789265564.155623:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789265564.155645:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876180579024384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265564.155666:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1789265564.155705:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876180579024384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265564.155711:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789265564.155745:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579024384:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789265564.211089:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265564.416189:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265564.416246:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265564.416275:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265564.416297:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265564.416325:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265564.416361:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556949760 00000100:00100000:1.0:1789265564.416375:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556949760 00000100:00100000:1.0:1789265564.416461:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 169 00000100:00100000:1.0:1789265564.416475:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556949760:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265564.416566:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556949760:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 94us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265564.416575:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 169 00000100:00100000:1.0:1789265564.416606:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556950016 00000100:00100000:1.0:1789265564.416610:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556950016 00000100:00100000:1.0:1789265564.416658:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556949632 00000100:00100000:1.0:1789265564.416662:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556949632 00000100:00100000:1.0:1789265564.416685:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556949888 00000100:00100000:1.0:1789265564.416687:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556949888 00000100:00100000:1.0:1789265564.416707:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 345 00000100:00100000:1.0:1789265564.416714:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556950016:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265564.416749:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556950016:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 35us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265564.416765:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 345 00000100:00100000:1.0:1789265564.416780:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 346 00000100:00100000:1.0:1789265564.416786:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556949632:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265564.416810:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2400:x1876180556949632:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265564.416816:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 346 00000100:00100000:1.0:1789265564.416840:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 347 00000100:00100000:1.0:1789265564.416846:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556949888:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265564.416918:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556949888:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 71us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265564.416924:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 347 00000100:00080000:1.0:1789265564.416949:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265564.416953:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265564.416957:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265564.423275:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556949504 00000100:00100000:3.0:1789265564.423300:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556949504 00000100:00100000:3.0:1789265564.423499:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 396 00000100:00100000:3.0:1789265564.423514:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:2400:x1876180556949504:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265564.423636:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+13:2400:x1876180556949504:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 125us (7462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265564.423645:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 396 00000040:00080000:2.0:1789265564.428132:0:14710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265564.428146:0:14710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265564.428182:0:14710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789265564.428190:0:14710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789265564.659320:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265564.659332:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265564.659376:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789265564.659389:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789265564.659559:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1876180579024512:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265564.659721:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff937758111c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265564.676531:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1876180579024512:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265564.676894:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265564.677002:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556950144 00000100:00100000:1.0:1789265564.677015:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556950144 00000100:00100000:1.0:1789265564.677101:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 250 00000100:00100000:1.0:1789265564.677115:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+27:12490:x1876180556950144:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789265564.677163:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789265564.677311:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+27:12490:x1876180556950144:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 199us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265564.677320:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 250 00000100:00100000:1.0:1789265564.684466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265564.684559:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556950400 00000100:00100000:2.0:1789265564.684573:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556950400 00000100:00100000:2.0:1789265564.684656:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 251 00000100:00100000:2.0:1789265564.684670:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+27:12490:x1876180556950400:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265564.684710:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265564.684740:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4a76 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9194ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265564.684950:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4a7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265564.684970:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4a7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265564.684987:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4a7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265564.685001:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789265564.685172:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fdc00/0xbbfdc9019c1d4a76 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194ee expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265564.685198:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4a7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194ee expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265564.685209:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:2.0:1789265564.685213:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265564.685216:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc400, rc 0) 00000100:00100000:2.0:1789265564.685290:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+29:12490:x1876180556950400:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 624us (841us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789265564.685298:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 251 00000100:00100000:0.0:1789265564.706981:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265564.707202:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265564.707298:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556950784 00000100:00100000:1.0:1789265564.707332:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556950784 00000100:00100000:1.0:1789265564.707429:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:1.0:1789265564.707442:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+29:2399:x1876180556950784:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265564.707464:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265564.707499:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc400/0xbbfdc9019c1d4a7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194ee expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265564.707525:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:1.0:1789265564.707531:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265564.707608:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+28:2399:x1876180556950784:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 169us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265564.707617:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:2.0:1789265564.708604:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556950656 00000100:00100000:2.0:1789265564.708616:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556950656 00000100:00100000:3.0:1789265564.709151:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 252 00000100:00100000:3.0:1789265564.709163:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+28:12490:x1876180556950656:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789265564.709268:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265564.709289:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265564.709303:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265564.709586:0:9988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265564.709596:0:9988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a8b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265564.709604:0:9988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265564.709611:0:9988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265564.709616:0:9988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265564.709625:0:9988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a8b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265564.709671:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:3.0:1789265564.709674:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789265564.709955:0:9988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a8b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265564.709964:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a5600/0xbbfdc9019c1d4a8b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265564.710211:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+29:12490:x1876180556950656:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 1044us (3240us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789265564.710221:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 252 00000040:00080000:2.0:1789265564.711140:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265564.711149:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265564.711756:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789265564.711773:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265564.715071:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265564.715253:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556951040 00000100:00100000:1.0:1789265564.715268:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556951040 00000100:00100000:1.0:1789265564.715347:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:1.0:1789265564.715368:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+29:12490:x1876180556951040:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789265564.715660:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+30:12490:x1876180556951040:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 301us (605us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789265564.715669:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:0.0:1789265565.174478:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579024640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265565.174580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265565.174738:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579024640 00000100:00100000:3.0:1789265565.174749:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579024640 00000100:00100000:3.0:1789265565.174825:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789265565.174836:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579024640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265565.174917:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789265565.174971:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579024640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265565.174979:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789265565.180056:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579024768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265565.180173:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265565.181058:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579024640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265565.183184:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579024768 00000100:00100000:3.0:1789265565.183214:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579024768 00000100:00100000:3.0:1789265565.183383:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789265565.183401:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579024768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265565.183476:0:10357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789265565.183621:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579024768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 224us (3447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265565.183631:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789265565.184208:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579024768:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789265565.235096:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265565.301624:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789265565.683133:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265565.683169:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579024896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265565.683291:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265565.683415:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579024896 00000100:00100000:1.0:1789265565.683426:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579024896 00000100:00100000:1.0:1789265565.683503:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789265565.683514:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579024896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265565.683565:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265565.683621:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579024896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265565.683630:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1789265565.683691:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265565.683726:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1789265565.683734:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:0.0:1789265565.683775:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93777f464700, transno 4294967308 00000004:00080000:0.0:1789265565.683797:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1789265565.683821:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9376435aad80, transno 4294967311 00000100:00100000:0.0:1789265565.683837:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579024896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265565.687043:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265565.687079:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579025024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265565.687178:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265565.687419:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579025024 00000100:00100000:1.0:1789265565.687430:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579025024 00000100:00100000:1.0:1789265565.687507:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789265565.687518:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579025024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265565.687549:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265565.687598:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579025024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265565.687603:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789265565.687666:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579025024:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789265565.687795:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789265565.747959:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265565.747976:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265565.748004:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789265565.748014:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789265566.260173:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265566.461461:0:14762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789265566.461477:0:14762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265566.461518:0:14762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789265566.461526:0:14762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789265566.662891:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265566.663005:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556951296 00000100:00100000:1.0:1789265566.663023:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556951296 00000100:00100000:1.0:1789265566.663121:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 253 00000100:00100000:1.0:1789265566.663217:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+30:12511:x1876180556951296:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1789265566.663253:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265566.663282:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d4a92 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9194f5 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265566.663516:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d4a99 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265566.663546:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d4a99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265566.663564:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d4a99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265566.663580:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000100:00080000:0.0:1789265566.663744:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789265566.663977:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd800/0xbbfdc9019c1d4a92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194f5 expref: 33 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265566.663999:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d4a99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194f5 expref: 32 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265566.664011:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:1.0:1789265566.664014:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789265566.664019:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bcc00, rc 0) 00000100:00100000:1.0:1789265566.664094:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+32:12511:x1876180556951296:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 963us (1236us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789265566.664103:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 253 00000100:00100000:3.0:1789265566.668009:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265566.668244:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556951424 00000100:00100000:1.0:1789265566.668260:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556951424 00000100:00100000:1.0:1789265566.668425:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 254 00000100:00100000:1.0:1789265566.668438:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+32:12511:x1876180556951424:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:1.0:1789265566.668529:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d4aa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265566.668553:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d4aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265566.668583:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d4aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265566.668642:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d4aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265566.668652:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d4aa7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265566.668660:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d4aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265566.668668:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bde00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265566.668673:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d4aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265566.668682:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d4aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265566.668697:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:1.0:1789265566.668702:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265566.668707:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d4aa7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265566.668714:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bde00/0xbbfdc9019c1d4aa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265566.668795:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+32:12511:x1876180556951424:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 359us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265566.668815:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 254 00000100:00100000:0.0:1789265566.782551:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265566.783077:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556951552 00000100:00100000:2.0:1789265566.783091:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556951552 00000100:00100000:2.0:1789265566.783193:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 79 00000100:00100000:2.0:1789265566.783208:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2397:x1876180556951552:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:2.0:1789265566.783233:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265566.783289:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000692433ea/0xbbfdc9019c1d4aae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9194fc expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265566.783461:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa6069c, atime: 0x6aa6069b, ctime: 0x6aa6069c, blocks: 0x8 00010000:00010000:2.0:1789265566.783495:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1789265566.783501:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265566.783515:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000692433ea/0xbbfdc9019c1d4aae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194fc expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265566.783541:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000692433ea/0xbbfdc9019c1d4aae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194fc expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265566.783558:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd600, rc 0) 00000100:00100000:2.0:1789265566.783649:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2397:x1876180556951552:12345-192.168.202.42@tcp:101:cat.0 Request processed in 447us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265566.783659:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 79 00000100:00080000:0.0:1789265566.783832:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265566.787537:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265566.790455:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556951680 00000100:00100000:1.0:1789265566.790505:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556951680 00002000:00100000:1.0:1789265566.790601:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff93774f158700 x1876180556951680/t0(0) o3->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:137/0 lens 488/0 e 0 to 0 dl 1789265577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789265566.790616:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93774f158700 with x1876180556951680 ext(0->4095) 00002000:00010000:1.0:1789265566.790634:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93774f158700 00000100:00100000:1.0:1789265566.790768:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:1.0:1789265566.790782:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2398:x1876180556951680:12345-192.168.202.42@tcp:3:cat.0 00000100:00100000:1.0:1789265566.791090:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+8:2398:x1876180556951680:12345-192.168.202.42@tcp:3:cat.0 Request processed in 310us (3567us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789265566.791099:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00002000:00100000:1.0:1789265566.791107:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff93774f158700 x1876180556951680/t0(0) o3->f16c02c5-6a63-4180-875a-2aaaca684c23@192.168.202.42@tcp:137/0 lens 488/4536 e 0 to 0 dl 1789265577 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789265566.791115:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93774f158700 with x1876180556951680 ext(0->4095) 00002000:00010000:1.0:1789265566.791118:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93774f158700 00010000:00010000:2.0:1789265567.283144:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265568.307175:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265568.762516:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180579025152:0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.762621:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265568.762704:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579025664:0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.762751:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265568.762790:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579026176:0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.762795:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579025408:0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.762819:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265568.762828:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265568.762840:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579026688:0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.762849:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180579025920:0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.762878:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265568.762896:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265568.762910:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789265568.762915:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180579026432:0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.762915:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579025280:0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.762938:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265568.763479:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180579025536:0@lo:400:kworker.0 00000100:00100000:3.0:1789265568.763984:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579026176 00000100:00100000:3.0:1789265568.763998:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579026176 00000100:00100000:3.0:1789265568.764520:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579026688 00000100:00100000:3.0:1789265568.764525:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579026688 00000100:00100000:3.0:1789265568.764556:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789265568.764569:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579026176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265568.764695:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789265568.764708:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1876180579026688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.767262:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265568.767332:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579026048:0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.767376:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265568.767389:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579026560:0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.767421:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265568.767474:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579025152 00000100:00100000:0.0:1789265568.767482:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579025152 00000100:00100000:0.0:1789265568.767545:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1789265568.767556:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180579025152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.767615:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180579025152:12345-0@lo:400:kworker.0 Request processed in 60us (4994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265568.767623:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1789265568.767677:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579025664 00000100:00100000:0.0:1789265568.767682:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579025664 00000100:00100000:0.0:1789265568.767710:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579025408 00000100:00100000:0.0:1789265568.767713:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579025408 00000100:00100000:0.0:1789265568.767738:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789265568.767747:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579025664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.767803:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579025664:12345-0@lo:400:kworker.0 Request processed in 57us (5052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265568.767810:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789265568.767822:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789265568.767828:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579025408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.767881:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579025408:12345-0@lo:400:kworker.0 Request processed in 31us (5030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265568.767887:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789265568.767907:0:9789:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789265568.767917:0:9789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789265568.767952:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579025920 00000100:00100000:0.0:1789265568.767957:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579025920 00000100:00100000:0.0:1789265568.767996:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579026432 00000100:00100000:0.0:1789265568.767999:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579026432 00000100:00100000:0.0:1789265568.768023:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579025536 00000100:00100000:0.0:1789265568.768026:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579025536 00000100:00100000:1.0:1789265568.769045:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579025408:0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.769118:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789265568.769134:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180579025920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.769592:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180579025920:12345-0@lo:400:kworker.0 Request processed in 462us (6693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265568.769601:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789265568.769631:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789265568.769640:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180579026432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.769799:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180579026432:12345-0@lo:400:kworker.0 Request processed in 161us (6860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265568.769806:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00080000:1.0:1789265568.770036:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f15bb80 x1876180579025920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265568.770051:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180579025920:0@lo:400:kworker.0 00010000:00080000:1.0:1789265568.770068:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f15ad80 x1876180579026432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265568.770076:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180579026432:0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.770177:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265568.770217:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180579025792:0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.770965:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579025280 00000100:00100000:0.0:1789265568.770977:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579025280 00000100:00100000:0.0:1789265568.771018:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789265568.771028:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180579025536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.771125:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180579025536:12345-0@lo:400:kworker.0 Request processed in 99us (3876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265568.771133:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789265568.771150:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789265568.771156:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579025280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.771185:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579025280:12345-0@lo:400:kworker.0 Request processed in 30us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265568.771191:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789265568.771243:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180579025536:0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.771881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265568.771919:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180579026304:0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.771950:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265568.771984:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180579025152:0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.772000:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579025664:0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.772027:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579025280:0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.772078:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579025792 00000100:00100000:1.0:1789265568.772084:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579025792 00000100:00100000:1.0:1789265568.772126:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579026304 00000100:00100000:1.0:1789265568.772129:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579026304 00000100:00100000:1.0:1789265568.772148:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789265568.772156:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180579025792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.772204:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180579025792:12345-0@lo:400:kworker.0 Request processed in 48us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265568.772559:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579026176:12345-0@lo:400:kworker.0 Request processed in 7992us (9737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265568.772572:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789265568.772596:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579026048 00000100:00100000:3.0:1789265568.772600:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579026048 00000100:00100000:3.0:1789265568.772621:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579026560 00000100:00100000:3.0:1789265568.772624:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579026560 00000100:00100000:3.0:1789265568.772655:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789265568.772663:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579026048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265568.772708:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579026048:12345-0@lo:400:kworker.0 Request processed in 46us (5331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265568.772714:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789265568.772726:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789265568.772745:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579026560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265568.772991:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579026560:12345-0@lo:400:kworker.0 Request processed in 245us (5566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265568.772997:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789265568.773192:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1789265568.773206:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180579026304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265568.773251:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180579026304:12345-0@lo:400:kworker.0 Request processed in 50us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265568.773256:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789265568.773381:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1876180579026688:12345-0@lo:400:kworker.0 Request processed in 8676us (10500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265568.773390:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789265568.773544:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789265568.773602:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180579025792:0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.773615:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180579026304:0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.773629:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579026176:0@lo:400:kworker.0 00000100:00100000:1.0:1789265568.773809:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579026688:0@lo:400:kworker.0 00000100:00080000:3.0:1789265568.774209:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265568.774216:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265568.774219:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265568.774222:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265568.774300:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579026048:0@lo:400:kworker.0 00000100:00100000:3.0:1789265568.774316:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579026560:0@lo:400:kworker.0 00000100:00100000:2.0:1789265569.268067:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265569.268104:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579026816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265569.268205:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265569.268594:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579026816 00000100:00100000:1.0:1789265569.268606:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579026816 00000100:00100000:1.0:1789265569.268689:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789265569.268703:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876180579026816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265569.268741:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789265569.268820:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876180579026816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265569.268829:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789265569.268917:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579026816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265569.270664:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265569.270691:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579026944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265569.270786:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265569.270985:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579026944 00000100:00100000:1.0:1789265569.270994:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579026944 00000100:00100000:1.0:1789265569.271062:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789265569.271086:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579026944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265569.271114:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789265569.271165:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579026944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265569.271173:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789265569.272850:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579026944:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1789265569.277390:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1789265569.277443:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9377435d79c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789265569.277449:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93774f393400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93775235aa80 00000020:00080000:0.0:1789265569.277471:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93774f393b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9376434e3a00 00000020:00080000:0.0:1789265569.277514:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1789265569.278100:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:0.0:1789265569.278108:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000020:00080000:2.0:1789265569.278339:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789265569.278452:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1789265569.278691:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4a29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265569.278707:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4a29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265569.278717:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4a29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265569.278724:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265569.278732:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4a29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265569.278740:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4a29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265569.278763:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93774e575600) 00010000:00010000:3.0:1789265569.278984:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265569.278992:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4a29 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265569.279011:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4800/0xbbfdc9019c1d4a29 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265569.338164:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265569.550066:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265569.550124:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265569.550161:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265569.552322:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265569.552392:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265569.552546:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556952192 00000100:00100000:1.0:1789265569.552560:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556952192 00000100:00100000:1.0:1789265569.552662:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 174 00000100:00100000:1.0:1789265569.552676:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556952192:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265569.552782:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556952192:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 98us (2645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265569.552792:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 174 00000100:00100000:1.0:1789265569.552828:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556951808 00000100:00100000:1.0:1789265569.552832:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556951808 00000100:00100000:1.0:1789265569.552891:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 398 00000100:00100000:1.0:1789265569.552899:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2399:x1876180556951808:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265569.552927:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2399:x1876180556951808:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 29us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265569.552934:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 398 00000100:00080000:1.0:1789265569.552965:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265569.558942:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265569.558992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265569.563608:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556951936 00000100:00100000:2.0:1789265569.564192:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556951936 00000100:00100000:2.0:1789265569.564354:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556952448 00000100:00100000:2.0:1789265569.564359:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556952448 00000100:00100000:2.0:1789265569.564384:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556952064 00000100:00100000:2.0:1789265569.564388:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556952064 00000100:00100000:2.0:1789265569.564416:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 354 00000100:00100000:2.0:1789265569.564430:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+18:2399:x1876180556951936:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265569.564547:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+18:2399:x1876180556951936:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 120us (14496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265569.564555:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 354 00000100:00100000:2.0:1789265569.564574:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 355 00000100:00100000:2.0:1789265569.564580:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556952448:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265569.564602:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556952448:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (14440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265569.564609:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 355 00000100:00100000:2.0:1789265569.564618:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 356 00000100:00100000:2.0:1789265569.564624:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556952064:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265569.564659:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2399:x1876180556952064:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 35us (12267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265569.565299:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556952576 00000100:00100000:3.0:1789265569.565307:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556952576 00000100:00100000:2.0:1789265569.565370:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 356 00000100:00080000:0.0:1789265569.565517:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265569.565523:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265569.567980:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556952320 00000100:00100000:1.0:1789265569.568000:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556952320 00000100:00100000:1.0:1789265569.568122:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 175 00000100:00100000:1.0:1789265569.568135:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556952320:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265569.568245:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2399:x1876180556952320:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 112us (9321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265569.568278:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 175 00000100:00080000:0.0:1789265569.568525:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265569.577218:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 357 00000100:00100000:1.0:1789265569.577248:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556952576:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265569.577375:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2399:x1876180556952576:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 140us (18382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265569.577384:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 357 00000100:00100000:2.0:1789265570.293356:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265570.293384:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579027072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265570.293463:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265570.293543:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265570.293552:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579027200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265570.293571:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265570.293599:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579027072 00000100:00100000:2.0:1789265570.293609:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579027072 00000100:00100000:2.0:1789265570.293664:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579027200 00000100:00100000:2.0:1789265570.293668:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579027200 00000100:00100000:2.0:1789265570.293686:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789265570.293697:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579027072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265570.293745:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789265570.293813:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579027072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265570.293821:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789265570.293842:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789265570.293849:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579027200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265570.293902:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265570.293937:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579027200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265570.293943:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789265570.294001:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579027200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265570.294040:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579027072:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789265570.359145:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265570.803953:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579027328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265570.804352:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265570.804369:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579027456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265570.804532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265570.804585:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579027328 00000100:00100000:3.0:1789265570.804597:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579027328 00000100:00100000:3.0:1789265570.804677:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789265570.804693:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579027328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265570.804730:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789265570.804800:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265570.814225:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265570.814778:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579027456 00000100:00100000:1.0:1789265570.814791:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579027456 00000100:00100000:1.0:1789265570.814928:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789265570.814942:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579027456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265570.814978:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789265570.815159:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265570.815291:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579027456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 352us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265570.815299:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789265570.815412:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579027456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265570.817996:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579027328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13296us (13451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265570.818027:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789265570.820431:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579027328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265571.379160:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265572.406608:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265572.746586:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265572.747148:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556952704 00000100:00100000:2.0:1789265572.747164:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556952704 00000100:00100000:2.0:1789265572.747263:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 255 00000100:00100000:2.0:1789265572.747278:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+18:12163:x1876180556952704:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789265572.747434:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+18:12163:x1876180556952704:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 Request processed in 159us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265572.747442:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 255 00000100:00080000:0.0:1789265572.747893:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265572.763152:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265572.763329:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556952832 00000100:00100000:2.0:1789265572.763344:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556952832 00000100:00100000:2.0:1789265572.763439:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 256 00000100:00100000:2.0:1789265572.763452:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:12163:x1876180556952832:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789265572.763594:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:12163:x1876180556952832:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 Request processed in 144us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265572.763602:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 256 00000100:00080000:0.0:1789265572.765888:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789265572.781878:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265572.782264:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556953088 00000100:00100000:3.0:1789265572.782279:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556953088 00000100:00100000:3.0:1789265572.782356:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:3.0:1789265572.782367:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+18:12163:x1876180556953088:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789265572.783420:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+19:12163:x1876180556953088:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 1045us (1566us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789265572.783451:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:3.0:1789265572.963537:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265572.963645:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556953216 00000100:00100000:1.0:1789265572.963658:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556953216 00000100:00080000:0.0:1789265572.963877:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265572.964295:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 257 00000100:00100000:1.0:1789265572.964310:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:12967:x1876180556953216:12345-192.168.202.42@tcp:101:lsof.0 00010000:00010000:1.0:1789265572.964337:0:9988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265572.964363:0:9988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d4ab5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919503 expref: -99 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265572.964462:0:9988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4abc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265572.964480:0:9988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4abc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265572.964494:0:9988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4abc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265572.964552:0:9988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789265572.964555:0:9988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265572.964580:0:9988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4abc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265572.964606:0:9988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d4ab5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919503 expref: 7 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265572.964627:0:9988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4abc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919503 expref: 6 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265572.964637:0:9988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d97a00) 00010000:00010000:1.0:1789265572.964640:0:9988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265572.964645:0:9988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc600, rc 0) 00000100:00100000:1.0:1789265572.964749:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:12967:x1876180556953216:12345-192.168.202.42@tcp:101:lsof.0 Request processed in 433us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265572.964758:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 257 00010000:00010000:2.0:1789265573.427312:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265573.875259:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180579027584:0@lo:400:kworker.0 00000100:00100000:2.0:1789265573.875368:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265573.875518:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579027584 00000100:00100000:3.0:1789265573.875532:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579027584 00000100:00100000:3.0:1789265573.875612:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789265573.875626:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180579027584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.876509:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579027712:0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.876571:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265573.876608:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265573.876614:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579027840:0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.876642:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265573.876698:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180579027968:0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.876726:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265573.876771:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579027712 00000100:00100000:0.0:1789265573.876778:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579027712 00000100:00100000:0.0:1789265573.876820:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579027968 00000100:00100000:0.0:1789265573.876823:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579027968 00000100:00100000:0.0:1789265573.876847:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1789265573.876855:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579027712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.876930:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579027712:12345-0@lo:400:kworker.0 Request processed in 75us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265573.876960:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1789265573.876981:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789265573.876986:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180579027968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.877021:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180579027968:12345-0@lo:400:kworker.0 Request processed in 34us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265573.877026:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789265573.877071:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180579027968:0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.877102:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579027712:0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.877144:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579027840 00000100:00100000:0.0:1789265573.877148:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579027840 00000100:00100000:0.0:1789265573.877175:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789265573.877181:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579027840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.877220:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579027840:12345-0@lo:400:kworker.0 Request processed in 39us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265573.877226:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789265573.877248:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579027840:0@lo:400:kworker.0 00000100:00100000:3.0:1789265573.887997:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3644:x1876180579027584:12345-0@lo:400:kworker.0 Request processed in 12358us (12612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265573.888019:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789265573.889596:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180579028224:0@lo:400:kworker.0 00000100:00100000:3.0:1789265573.889704:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265573.889762:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180579028736:0@lo:400:kworker.0 00000100:00100000:3.0:1789265573.889788:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265573.889820:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789265573.889826:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180579028352:0@lo:400:kworker.0 00000100:00100000:3.0:1789265573.889850:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265573.889899:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180579028864:0@lo:400:kworker.0 00000100:00100000:3.0:1789265573.889920:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265573.889956:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579028224 00000100:00100000:3.0:1789265573.889977:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579028224 00000100:00100000:3.0:1789265573.890045:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579028736 00000100:00100000:3.0:1789265573.890049:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579028736 00000100:00100000:3.0:1789265573.890067:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579028352 00000100:00100000:3.0:1789265573.890070:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579028352 00000100:00100000:3.0:1789265573.890083:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579028864 00000100:00100000:3.0:1789265573.890085:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579028864 00000100:00100000:3.0:1789265573.890130:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789265573.890140:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180579028224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265573.890205:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180579028224:12345-0@lo:400:kworker.0 Request processed in 66us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265573.890213:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789265573.890233:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789265573.890240:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180579028736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265573.890269:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180579028736:12345-0@lo:400:kworker.0 Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265573.890274:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789265573.890284:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789265573.890289:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180579028352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265573.890312:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180579028352:12345-0@lo:400:kworker.0 Request processed in 23us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265573.890317:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789265573.890325:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789265573.890330:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180579028864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265573.890353:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180579028864:12345-0@lo:400:kworker.0 Request processed in 23us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265573.890359:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00080000:3.0:1789265573.890377:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265573.890382:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789265573.890424:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f159f80 x1876180579028352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265573.890440:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180579028352:0@lo:400:kworker.0 00010000:00080000:3.0:1789265573.890463:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f15b100 x1876180579028864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265573.890472:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180579028864:0@lo:400:kworker.0 00000100:00100000:3.0:1789265573.890482:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180579028224:0@lo:400:kworker.0 00000100:00100000:3.0:1789265573.890491:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180579028736:0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.891765:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579028480:0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.891846:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265573.891932:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579028992:0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.891955:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265573.891988:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789265573.891995:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579028096:0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.892020:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265573.892060:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579028608:0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.892082:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265573.892097:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579029120:0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.892115:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265573.892180:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579028096 00000100:00100000:0.0:1789265573.892188:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579028096 00000100:00100000:0.0:1789265573.892239:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789265573.892248:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579028096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265573.892306:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579028096:12345-0@lo:400:kworker.0 Request processed in 60us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265573.892313:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789265573.892356:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579028096:0@lo:400:kworker.0 00000100:00100000:1.0:1789265573.892502:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579028480 00000100:00100000:1.0:1789265573.892507:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579028480 00000100:00100000:1.0:1789265573.892562:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579028992 00000100:00100000:1.0:1789265573.892565:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579028992 00000100:00100000:1.0:1789265573.892576:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579028608 00000100:00100000:1.0:1789265573.892579:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579028608 00000100:00100000:1.0:1789265573.892590:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579029120 00000100:00100000:1.0:1789265573.892592:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579029120 00000100:00100000:1.0:1789265573.892604:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789265573.892611:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579028480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265573.892654:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579028480:12345-0@lo:400:kworker.0 Request processed in 44us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265573.892660:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789265573.892673:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789265573.892678:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579028992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265573.892717:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579028992:12345-0@lo:400:kworker.0 Request processed in 39us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265573.892723:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789265573.892747:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789265573.892753:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579028608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265573.892778:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579028608:12345-0@lo:400:kworker.0 Request processed in 26us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265573.892784:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789265573.892794:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789265573.892799:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579029120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265573.892837:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579029120:12345-0@lo:400:kworker.0 Request processed in 25us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265573.892843:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789265573.892910:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579028608:0@lo:400:kworker.0 00000100:00100000:1.0:1789265573.892927:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1789265573.892933:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93777f581c00, transno 4294967323 00000004:00080000:1.0:1789265573.892947:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1789265573.892982:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579029120:0@lo:400:kworker.0 00000100:00100000:1.0:1789265573.892994:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579028480:0@lo:400:kworker.0 00000100:00100000:1.0:1789265573.893004:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579028992:0@lo:400:kworker.0 00000100:00080000:0.0:1789265573.893675:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265573.893683:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265573.893821:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180579027584:0@lo:400:kworker.0 00000100:00100000:0.0:1789265574.388742:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265574.388786:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579029248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265574.388919:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265574.389137:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579029248 00000100:00100000:3.0:1789265574.389149:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579029248 00000100:00100000:3.0:1789265574.389208:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789265574.389220:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579029248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265574.389259:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789265574.389325:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579029248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265574.389333:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789265574.389643:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579029248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265574.390604:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579029376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265574.390708:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265574.391033:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579029376 00000100:00100000:2.0:1789265574.391042:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579029376 00000100:00100000:2.0:1789265574.391107:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789265574.391119:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579029376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265574.391147:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789265574.391211:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579029376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265574.391238:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789265574.391395:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579029376:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789265574.451090:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265574.655363:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265574.655403:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265574.655429:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265574.655458:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265574.655494:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265574.655515:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265574.655539:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265574.655583:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556953600 00000100:00100000:0.0:1789265574.655593:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556953600 00000100:00100000:3.0:1789265574.655920:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556954112 00000100:00100000:3.0:1789265574.655925:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556954112 00000100:00100000:3.0:1789265574.655950:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556953472 00000100:00100000:3.0:1789265574.655952:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556953472 00000100:00100000:3.0:1789265574.655965:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556953984 00000100:00100000:3.0:1789265574.655968:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556953984 00000100:00100000:3.0:1789265574.655984:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 364 00000100:00100000:3.0:1789265574.655993:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556953600:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265574.656086:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556953600:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 93us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265574.656093:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 364 00000100:00100000:3.0:1789265574.656112:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 365 00000100:00100000:3.0:1789265574.656127:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556954112:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265574.656153:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556954112:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 27us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265574.656159:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 365 00000100:00100000:3.0:1789265574.656173:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 366 00000100:00100000:3.0:1789265574.656179:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+19:2398:x1876180556953472:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265574.656208:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+19:2398:x1876180556953472:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 29us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265574.656215:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 366 00000100:00100000:3.0:1789265574.656226:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 367 00000100:00100000:3.0:1789265574.656232:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2398:x1876180556953984:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265574.656253:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2398:x1876180556953984:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265574.656258:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 367 00000100:00080000:3.0:1789265574.656406:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265574.656410:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265574.657317:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556953344 00000100:00100000:1.0:1789265574.657326:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556953344 00000100:00100000:1.0:1789265574.657381:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 400 00000100:00100000:1.0:1789265574.657390:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556953344:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265574.657453:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556953856 00000100:00100000:1.0:1789265574.657459:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556953344:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 68us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265574.657467:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556953856 00000100:00100000:1.0:1789265574.657476:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 400 00000100:00100000:1.0:1789265574.657523:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556953728 00000100:00100000:1.0:1789265574.657528:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556953728 00000100:00100000:2.0:1789265574.657572:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 180 00000100:00100000:1.0:1789265574.657593:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 181 00000100:00100000:2.0:1789265574.657602:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2398:x1876180556953856:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265574.657609:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556953728:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265574.657703:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2398:x1876180556953856:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 119us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265574.657713:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 180 00000100:00080000:2.0:1789265574.657752:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265574.657757:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265574.658335:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556953728:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 730us (2815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265574.658345:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 181 00000100:00100000:2.0:1789265575.411762:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265575.411800:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579029504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265575.411925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265575.412008:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579029504 00000100:00100000:2.0:1789265575.412018:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579029504 00000100:00100000:2.0:1789265575.412082:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789265575.412094:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579029504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265575.412142:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265575.412195:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579029504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265575.412204:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789265575.412296:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579029504:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1789265575.417844:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1789265575.417904:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789265575.417998:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789265575.418013:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1789265575.418702:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579029632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265575.418845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265575.433089:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579029632 00000100:00100000:0.0:1789265575.433119:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579029632 00000100:00100000:0.0:1789265575.433414:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789265575.433428:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579029632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265575.433481:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789265575.433609:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579029632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 185us (14765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265575.433619:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789265575.433676:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579029632:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789265575.475186:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265575.540058:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789265575.928188:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579029888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265575.928301:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265575.928408:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265575.928416:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579029760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265575.928440:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265575.928551:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579029888 00000100:00100000:1.0:1789265575.928562:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579029888 00000100:00100000:1.0:1789265575.928635:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579029760 00000100:00100000:1.0:1789265575.928655:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579029760 00000100:00100000:1.0:1789265575.928686:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789265575.928695:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579029888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265575.928745:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265575.928801:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579029888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265575.928809:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789265575.928827:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789265575.928833:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579029760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265575.928842:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789265575.928894:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579029760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265575.928900:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789265575.928947:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579029760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265575.928960:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579029888:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265575.929213:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789265575.987194:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789265575.987211:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265575.987364:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789265575.987377:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789265576.499219:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789265577.301437:0:14960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:12:56 (1789265576) 00010000:00010000:1.0:1789265577.522976:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265578.549157:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265578.995403:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579030272:0@lo:400:kworker.0 00000100:00100000:2.0:1789265578.995478:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265578.995535:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180579030784:0@lo:400:kworker.0 00000100:00100000:2.0:1789265578.995562:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265578.995581:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180579031296:0@lo:400:kworker.0 00000100:00100000:2.0:1789265578.995602:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265578.995627:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789265578.995634:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579030400:0@lo:400:kworker.0 00000100:00100000:2.0:1789265578.995655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265578.995696:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579030912:0@lo:400:kworker.0 00000100:00100000:2.0:1789265578.995721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265578.995740:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579031424:0@lo:400:kworker.0 00000100:00100000:2.0:1789265578.995761:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265578.995797:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579030272 00000100:00100000:2.0:1789265578.995804:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579030272 00000100:00100000:2.0:1789265578.995851:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789265578.995886:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579030272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265578.995947:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579030272:12345-0@lo:400:kworker.0 Request processed in 87us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265578.995955:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789265578.995982:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579030784 00000100:00100000:2.0:1789265578.995986:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579030784 00000100:00100000:3.0:1789265578.996061:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180579030144:0@lo:400:kworker.0 00000100:00100000:3.0:1789265578.996092:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265578.996173:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180579030016:0@lo:400:kworker.0 00000100:00100000:1.0:1789265578.996210:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265578.996237:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579030528:0@lo:400:kworker.0 00000100:00100000:1.0:1789265578.996258:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265579.002172:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579030016 00000100:00100000:0.0:1789265579.002189:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579030016 00000100:00100000:0.0:1789265579.002254:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789265579.002265:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3643:x1876180579030016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265579.002358:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3643:x1876180579030016:12345-0@lo:400:kworker.0 Request processed in 96us (6146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.002365:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789265579.002444:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579030912 00000100:00100000:0.0:1789265579.002449:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579030912 00000100:00100000:3.0:1789265579.006558:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180579030656:0@lo:400:kworker.0 00000100:00100000:3.0:1789265579.006622:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265579.006644:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180579031168:0@lo:400:kworker.0 00000100:00100000:3.0:1789265579.006691:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265579.021220:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579031424 00000100:00100000:0.0:1789265579.021234:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579031424 00000100:00100000:0.0:1789265579.021266:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789265579.021277:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579030912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265579.021362:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579030912:12345-0@lo:400:kworker.0 Request processed in 88us (25640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.021369:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789265579.021385:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789265579.021390:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579031424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265579.021414:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579031424:12345-0@lo:400:kworker.0 Request processed in 24us (25653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.021419:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789265579.021446:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579031296 00000100:00100000:0.0:1789265579.021449:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579031296 00000100:00100000:0.0:1789265579.021471:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579030400 00000100:00100000:0.0:1789265579.021473:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579030400 00000100:00100000:0.0:1789265579.021483:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579030144 00000100:00100000:0.0:1789265579.021485:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579030144 00000100:00100000:0.0:1789265579.021494:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579030656 00000100:00100000:0.0:1789265579.021496:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579030656 00000100:00100000:0.0:1789265579.021509:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579031168 00000100:00100000:0.0:1789265579.021512:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579031168 00000100:00100000:0.0:1789265579.021525:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789265579.021531:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180579031296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265579.021565:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876180579031296:12345-0@lo:400:kworker.0 Request processed in 34us (25962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.021571:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789265579.021594:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789265579.021600:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579030400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265579.021628:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579030400:12345-0@lo:400:kworker.0 Request processed in 29us (25972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.021634:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789265579.021646:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789265579.021651:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180579030144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265579.021727:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180579030144:12345-0@lo:400:kworker.0 Request processed in 76us (25634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.021733:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789265579.021744:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789265579.021751:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180579030656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265579.021780:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180579030656:12345-0@lo:400:kworker.0 Request processed in 30us (15158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.021785:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789265579.021797:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789265579.021803:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180579031168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265579.021827:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180579031168:12345-0@lo:400:kworker.0 Request processed in 25us (15159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.021833:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00080000:0.0:1789265579.021853:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265579.021877:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265579.021879:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265579.021882:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265579.021934:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180579030144:0@lo:400:kworker.0 00000100:00100000:0.0:1789265579.021947:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180579030656:0@lo:400:kworker.0 00000100:00100000:0.0:1789265579.021966:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180579031168:0@lo:400:kworker.0 00000100:00100000:1.0:1789265579.022166:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579031040:0@lo:400:kworker.0 00000100:00100000:1.0:1789265579.022212:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265579.022236:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579031040 00000100:00100000:1.0:1789265579.022240:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579031040 00000100:00100000:1.0:1789265579.022274:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789265579.022280:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579031040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265579.022309:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579031040:12345-0@lo:400:kworker.0 Request processed in 29us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265579.022314:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:1.0:1789265579.022328:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265579.022347:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579031040:0@lo:400:kworker.0 00000100:00100000:1.0:1789265579.022353:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579031552:0@lo:400:kworker.0 00000100:00100000:1.0:1789265579.022376:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265579.022399:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579031552 00000100:00100000:1.0:1789265579.022402:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579031552 00000100:00100000:1.0:1789265579.022425:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789265579.022430:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579031552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265579.022458:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579031552:12345-0@lo:400:kworker.0 Request processed in 28us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265579.022464:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:1.0:1789265579.022477:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265579.022495:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579031552:0@lo:400:kworker.0 00000100:00100000:1.0:1789265579.022516:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180579030016:0@lo:400:kworker.0 00000100:00100000:3.0:1789265579.024501:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579030400:0@lo:400:kworker.0 00000100:00100000:3.0:1789265579.024519:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579030912:0@lo:400:kworker.0 00000100:00100000:3.0:1789265579.024532:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579031424:0@lo:400:kworker.0 00000100:00100000:3.0:1789265579.024544:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579030272:0@lo:400:kworker.0 00010000:00080000:3.0:1789265579.024560:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f43b100 x1876180579031296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265579.024572:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876180579031296:0@lo:400:kworker.0 00000100:00100000:3.0:1789265579.024653:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789265579.024988:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180579030784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265579.026426:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579030528 00000100:00100000:2.0:1789265579.026437:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579030528 00000100:00100000:2.0:1789265579.026485:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789265579.026502:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579030528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265579.026597:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579030528:12345-0@lo:400:kworker.0 Request processed in 98us (30337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265579.026605:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789265579.026900:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579030528:0@lo:400:kworker.0 00000100:00100000:2.0:1789265579.031046:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180579030784:12345-0@lo:400:kworker.0 Request processed in 6377us (35474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265579.031061:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00010000:00080000:2.0:1789265579.032005:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f43ad80 x1876180579030784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265579.032023:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180579030784:0@lo:400:kworker.0 00000100:00100000:2.0:1789265579.507068:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265579.507095:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579031680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265579.507187:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265579.507256:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579031680 00000100:00100000:2.0:1789265579.507263:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579031680 00000100:00100000:2.0:1789265579.507312:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789265579.507322:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579031680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265579.507355:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789265579.507406:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579031680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265579.507415:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789265579.507467:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579031680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265579.508923:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579031808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265579.508982:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265579.509102:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579031808 00000100:00100000:0.0:1789265579.509120:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579031808 00000100:00100000:0.0:1789265579.509165:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789265579.509173:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579031808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265579.509194:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789265579.509239:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579031808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.509247:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789265579.509290:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579031808:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789265579.579576:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265579.777926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265579.777960:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265579.777983:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265579.778007:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265579.778027:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265579.778048:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265579.778073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265579.778122:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556954368 00000100:00100000:0.0:1789265579.778132:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556954368 00000100:00100000:0.0:1789265579.778191:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556954880 00000100:00100000:0.0:1789265579.778195:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556954880 00000100:00100000:0.0:1789265579.778211:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556954496 00000100:00100000:0.0:1789265579.778214:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556954496 00000100:00100000:0.0:1789265579.778229:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556955008 00000100:00100000:0.0:1789265579.778232:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556955008 00000100:00100000:0.0:1789265579.778249:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 374 00000100:00100000:0.0:1789265579.778259:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+18:2398:x1876180556954368:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265579.778347:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+18:2398:x1876180556954368:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 89us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.778355:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 374 00000100:00100000:0.0:1789265579.778374:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 375 00000100:00100000:0.0:1789265579.778401:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2398:x1876180556954880:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265579.778428:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2398:x1876180556954880:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 47us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.778434:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 375 00000100:00100000:0.0:1789265579.778447:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 376 00000100:00100000:0.0:1789265579.778453:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556954496:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265579.778475:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556954496:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.778481:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 376 00000100:00100000:0.0:1789265579.778493:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 377 00000100:00100000:0.0:1789265579.778499:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556955008:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265579.778522:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2398:x1876180556955008:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.778528:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 377 00000100:00100000:0.0:1789265579.778548:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556954624 00000100:00100000:0.0:1789265579.778551:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556954624 00000100:00100000:0.0:1789265579.778578:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556954752 00000100:00100000:0.0:1789265579.778581:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556954752 00000100:00100000:0.0:1789265579.778601:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 186 00000100:00100000:0.0:1789265579.778608:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556954624:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265579.778644:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2398:x1876180556954624:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 36us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.778651:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 186 00000100:00100000:0.0:1789265579.778663:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 187 00000100:00100000:0.0:1789265579.778669:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2398:x1876180556954752:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265579.778718:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2398:x1876180556954752:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 38us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.778726:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 187 00000100:00100000:0.0:1789265579.778748:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556954240 00000100:00100000:0.0:1789265579.778752:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556954240 00000100:00100000:0.0:1789265579.778777:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 402 00000100:00100000:0.0:1789265579.778784:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556954240:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265579.778810:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2398:x1876180556954240:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265579.778817:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 402 00000100:00080000:0.0:1789265579.778850:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265579.778854:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265579.778877:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265579.778879:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265580.531141:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265580.531168:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579031936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265580.531268:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265580.531513:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579031936 00000100:00100000:2.0:1789265580.531530:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579031936 00000100:00100000:2.0:1789265580.531590:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789265580.531600:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579031936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265580.531637:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789265580.531729:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579031936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265580.531737:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789265580.532083:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579031936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265580.532429:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579032064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265580.532472:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265580.532611:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579032064 00000100:00100000:2.0:1789265580.532617:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579032064 00000100:00100000:2.0:1789265580.532658:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789265580.532682:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579032064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265580.532719:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789265580.532762:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579032064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265580.532770:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789265580.533390:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579032064:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789265580.595422:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265581.044452:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265581.044479:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579032192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265581.044551:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265581.044627:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579032192 00000100:00100000:3.0:1789265581.044635:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579032192 00000100:00100000:3.0:1789265581.044826:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789265581.044849:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579032192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265581.044912:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265581.044961:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579032192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265581.044968:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789265581.045015:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579032192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265581.045171:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579032320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265581.045215:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265581.045428:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579032320 00000100:00100000:3.0:1789265581.045433:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579032320 00000100:00100000:3.0:1789265581.045469:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789265581.045477:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579032320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265581.045488:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265581.045524:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579032320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265581.045530:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789265581.045560:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579032320:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789265581.054938:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789265581.619878:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265582.409372:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265582.411963:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556955264 00000100:00100000:2.0:1789265582.411978:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556955264 00000100:00100000:2.0:1789265582.412067:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:2.0:1789265582.412082:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+18:13191:x1876180556955264:12345-192.168.202.42@tcp:35:umount.0 00000100:00100000:2.0:1789265582.412417:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+19:13191:x1876180556955264:12345-192.168.202.42@tcp:35:umount.0 Request processed in 338us (3053us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789265582.412426:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00080000:0.0:1789265582.412521:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265582.418255:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265582.418740:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556955520 00000100:00100000:1.0:1789265582.418752:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556955520 00000100:00100000:1.0:1789265582.418817:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:1.0:1789265582.418828:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+19:13191:x1876180556955520:12345-192.168.202.42@tcp:35:umount.0 00000100:00100000:1.0:1789265582.419235:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+20:13191:x1876180556955520:12345-192.168.202.42@tcp:35:umount.0 Request processed in 407us (1072us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789265582.419244:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:3.0:1789265582.428932:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265582.429022:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556955776 00000100:00100000:0.0:1789265582.429034:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556955776 00000100:00100000:0.0:1789265582.429103:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:0.0:1789265582.429115:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775f4ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+20:13191:x1876180556955776:12345-192.168.202.42@tcp:35:umount.0 00000100:00100000:0.0:1789265582.429607:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775f4ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+21:13191:x1876180556955776:12345-192.168.202.42@tcp:35:umount.0 Request processed in 492us (682us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789265582.429616:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:2.0:1789265582.437045:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265582.437150:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556956032 00000100:00100000:3.0:1789265582.437160:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556956032 00000100:00100000:3.0:1789265582.437219:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:3.0:1789265582.437230:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+21:13191:x1876180556956032:12345-192.168.202.42@tcp:35:umount.0 00000100:00100000:3.0:1789265582.437809:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f16c02c5-6a63-4180-875a-2aaaca684c23+22:13191:x1876180556956032:12345-192.168.202.42@tcp:35:umount.0 Request processed in 578us (771us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789265582.437817:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:2.0:1789265582.450531:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265582.450584:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265582.450625:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265582.450727:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556956288 00000100:00100000:1.0:1789265582.450740:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556956288 00000100:00100000:1.0:1789265582.450807:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556956160 00000100:00100000:1.0:1789265582.450811:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556956160 00000100:00100000:1.0:1789265582.450826:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556956416 00000100:00100000:1.0:1789265582.450829:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556956416 00000100:00100000:1.0:1789265582.450846:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:1.0:1789265582.450857:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+15:2400:x1876180556956288:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265582.450893:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265582.450915:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937782163600/0xbbfdc9019c1d39d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919017 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265582.450932:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265582.450988:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+14:2400:x1876180556956288:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 132us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265582.450996:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:1.0:1789265582.451017:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:1.0:1789265582.451032:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+13:2400:x1876180556956160:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265582.451039:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265582.451048:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643218000/0xbbfdc9019c1d3a93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919056 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265582.451057:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265582.451074:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+12:2400:x1876180556956160:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 44us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265582.451080:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:1.0:1789265582.451094:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:1.0:1789265582.451101:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377583da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+11:2400:x1876180556956416:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265582.451108:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265582.451117:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643219600/0xbbfdc9019c1d3ce6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91912f expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265582.451126:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265582.451142:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377583da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+10:2400:x1876180556956416:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 42us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265582.451148:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:0.0:1789265582.458503:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265582.458593:0:14823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556956800 00000100:00100000:2.0:1789265582.458604:0:14823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556956800 00000100:00100000:2.0:1789265582.458686:0:14823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 80 00000100:00100000:2.0:1789265582.458698:0:14823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+7:2396:x1876180556956800:12345-192.168.202.42@tcp:9:umount.0 00000020:00000080:2.0:1789265582.458730:0:14823:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d4027 00000020:00010000:2.0:1789265582.458739:0:14823:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93777f39d000: total 0 00000100:00080000:2.0:1789265582.458745:0:14823:0:(import.c:65:import_set_state_nolock()) ffff9376436fd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265582.458800:0:14823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789265582.459003:0:14823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2396:x1876180556956800:12345-192.168.202.42@tcp:9:umount.0 Request processed in 307us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265582.459011:0:14823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 80 00000020:00010000:3.0:1789265582.459513:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93777f39d000: total 0 00010000:00010000:3.0:1789265582.459560:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93777f39d000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789265582.459617:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a17df5a/0xbbfdc9019c1d43df lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919319 expref: 4 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.459667:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000692433ea/0xbbfdc9019c1d4aae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194fc expref: 3 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.459685:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93777f39d000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789265582.459697:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265582.459699:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265582.459701:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265582.459937:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265582.466975:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265582.467069:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556956928 00000100:00100000:0.0:1789265582.467080:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556956928 00000100:00100000:0.0:1789265582.467166:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 81 00000100:00100000:0.0:1789265582.467177:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2396:x1876180556956928:12345-192.168.202.42@tcp:9:umount.0 00000020:00000080:0.0:1789265582.467208:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3db1 00000100:00080000:0.0:1789265582.467218:0:8436:0:(import.c:65:import_set_state_nolock()) ffff93777f39c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265582.467266:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789265582.467431:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f16c02c5-6a63-4180-875a-2aaaca684c23+2:2396:x1876180556956928:12345-192.168.202.42@tcp:9:umount.0 Request processed in 256us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265582.467439:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 81 00010000:00010000:3.0:1789265582.467626:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265582.468717:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265582.477619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265582.477906:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556957952 00000100:00100000:0.0:1789265582.477918:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556957952 00000100:00100000:0.0:1789265582.477978:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 258 00000100:00100000:0.0:1789265582.477989:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+22:2396:x1876180556957952:12345-192.168.202.42@tcp:39:umount.0 00000020:00000080:0.0:1789265582.478022:0:6519:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d39e4 00000020:00010000:0.0:1789265582.478039:0:6519:0:(genops.c:1921:obd_stale_export_put()) Put export ffff937642769000: total 0 00000100:00080000:0.0:1789265582.478044:0:6519:0:(import.c:65:import_set_state_nolock()) ffff93764276f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265582.478075:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1789265582.478245:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f16c02c5-6a63-4180-875a-2aaaca684c23+21:2396:x1876180556957952:12345-192.168.202.42@tcp:39:umount.0 Request processed in 256us (632us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789265582.478254:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 258 00000020:00010000:3.0:1789265582.478519:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff937642769000: total 0 00010000:00010000:3.0:1789265582.478569:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff937642769000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789265582.478603:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93774712fb00) 00010000:00010000:3.0:1789265582.478607:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265582.478615:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393000/0xbbfdc9019c1d3d10 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91913d expref: 20 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.478637:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:3.0:1789265582.478640:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789265582.478661:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393200/0xbbfdc9019c1d4464 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91933c expref: 19 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.478676:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:3.0:1789265582.478678:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265582.478683:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393c00/0xbbfdc9019c1d4a6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194e7 expref: 18 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.478706:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:3.0:1789265582.478708:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265582.478712:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fda00/0xbbfdc9019c1d42c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9192cc expref: 17 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.478726:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93774e575200) 00010000:00010000:3.0:1789265582.478729:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265582.478732:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fc200/0xbbfdc9019c1d4751 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919415 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.478748:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d97a00) 00010000:00010000:3.0:1789265582.478750:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265582.478754:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d4448 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919335 expref: 15 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.478765:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:3.0:1789265582.478767:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789265582.478770:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d4a99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194f5 expref: 14 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.478782:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:3.0:1789265582.478784:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789265582.478787:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9376435fd200/0xbbfdc9019c1d3d87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919159 expref: 13 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.478797:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:3.0:1789265582.478799:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789265582.478812:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc200/0xbbfdc9019c1d43ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919312 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.478826:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93774712f300) 00010000:00010000:3.0:1789265582.478827:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265582.478831:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393400/0xbbfdc9019c1d3d2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919144 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.478843:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff937777820a00) 00010000:00010000:3.0:1789265582.478845:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265582.478848:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392c00/0xbbfdc9019c1d43a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919304 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.478901:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9377522feb00) 00010000:00010000:3.0:1789265582.478904:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265582.478909:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377465a4600/0xbbfdc9019c1d498f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9194af expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.478926:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff937779d90200) 00010000:00010000:3.0:1789265582.478929:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789265582.478932:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93774167fc00/0xbbfdc9019c1d4082 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919232 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265582.478946:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff937642769000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789265582.478959:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265582.478961:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265582.478963:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265582.493970:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265582.494075:0:9988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556958080 00000100:00100000:3.0:1789265582.494086:0:9988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556958080 00000100:00100000:3.0:1789265582.494176:0:9988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 259 00000100:00100000:3.0:1789265582.494187:0:9988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+5:2396:x1876180556958080:12345-192.168.202.42@tcp:39:umount.0 00000020:00000080:3.0:1789265582.494221:0:9988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d39eb 00000100:00080000:3.0:1789265582.494238:0:9988:0:(import.c:65:import_set_state_nolock()) ffff93777f36b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265582.494280:0:9988:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789265582.494464:0:9988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f16c02c5-6a63-4180-875a-2aaaca684c23+3:2396:x1876180556958080:12345-192.168.202.42@tcp:39:umount.0 Request processed in 279us (505us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789265582.494472:0:9988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 259 00010000:00010000:1.0:1789265582.494939:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265582.495108:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789265582.643481:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265583.668470:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265584.115123:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265584.115282:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579032704:0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.115374:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265584.115443:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265584.115450:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180579032576:0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.115474:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265584.115512:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579032576 00000100:00100000:2.0:1789265584.115520:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579032576 00000100:00100000:2.0:1789265584.115570:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789265584.115579:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180579032576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.115668:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180579032576:12345-0@lo:400:kworker.0 Request processed in 57us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.115693:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789265584.115742:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180579032576:0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.115782:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579032704 00000100:00100000:2.0:1789265584.115785:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579032704 00000100:00100000:2.0:1789265584.115812:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789265584.115819:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579032704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.115884:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579032704:12345-0@lo:400:kworker.0 Request processed in 39us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.115891:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789265584.115919:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579032704:0@lo:400:kworker.0 00000100:00100000:3.0:1789265584.119191:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579032832:0@lo:400:kworker.0 00000100:00100000:3.0:1789265584.119841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265584.119933:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180579032448:0@lo:400:kworker.0 00000100:00100000:3.0:1789265584.119972:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265584.120110:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579032832 00000100:00100000:1.0:1789265584.120119:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579032832 00000100:00100000:1.0:1789265584.120176:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789265584.120186:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579032832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265584.120244:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579032832:12345-0@lo:400:kworker.0 Request processed in 60us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265584.120276:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789265584.120496:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579032448 00000100:00100000:2.0:1789265584.120501:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579032448 00000100:00100000:2.0:1789265584.120543:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1789265584.120552:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180579032448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.120587:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180579032448:12345-0@lo:400:kworker.0 Request processed in 38us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.120594:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789265584.120703:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579032832:0@lo:400:kworker.0 00000100:00100000:3.0:1789265584.120713:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180579032448:0@lo:400:kworker.0 00000100:00100000:0.0:1789265584.122141:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180579033088:0@lo:400:kworker.0 00000100:00100000:0.0:1789265584.122206:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265584.122238:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180579033600:0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.122600:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579032960:0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.122646:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265584.122667:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579033472:0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.122689:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265584.122708:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579033984:0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.122727:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265584.122748:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789265584.122771:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579033344:0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.122793:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265584.122812:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579033856:0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.122831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265584.122880:0:14823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579033472 00000100:00100000:2.0:1789265584.122887:0:14823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579033472 00000100:00100000:2.0:1789265584.122936:0:14823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579033984 00000100:00100000:2.0:1789265584.122939:0:14823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579033984 00000100:00100000:2.0:1789265584.122952:0:14823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579033344 00000100:00100000:2.0:1789265584.122954:0:14823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579033344 00000100:00100000:2.0:1789265584.122964:0:14823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579033856 00000100:00100000:2.0:1789265584.122967:0:14823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579033856 00000100:00100000:2.0:1789265584.122980:0:14823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789265584.122987:0:14823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579033472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.123039:0:14823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579033472:12345-0@lo:400:kworker.0 Request processed in 52us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.123046:0:14823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789265584.123063:0:14823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789265584.123069:0:14823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579033984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.123097:0:14823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579033984:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.123102:0:14823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789265584.123112:0:14823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789265584.123117:0:14823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579033344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.123140:0:14823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579033344:12345-0@lo:400:kworker.0 Request processed in 24us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.123144:0:14823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789265584.123162:0:14823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789265584.123167:0:14823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579033856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.123193:0:14823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579033856:12345-0@lo:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.123198:0:14823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789265584.123238:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579033344:0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.123247:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579033856:0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.123256:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579033472:0@lo:400:kworker.0 00000100:00100000:2.0:1789265584.123276:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579033984:0@lo:400:kworker.0 00000100:00100000:1.0:1789265584.123529:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579033088 00000100:00100000:1.0:1789265584.123535:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579033088 00000100:00100000:0.0:1789265584.123775:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265584.123809:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789265584.123818:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180579033216:0@lo:400:kworker.0 00000100:00100000:0.0:1789265584.123850:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265584.123881:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180579033728:0@lo:400:kworker.0 00000100:00100000:0.0:1789265584.123900:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265584.123935:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579033600 00000100:00100000:0.0:1789265584.123939:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579033600 00000100:00100000:0.0:1789265584.123961:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579033216 00000100:00100000:0.0:1789265584.123964:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579033216 00000100:00100000:0.0:1789265584.123976:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579033728 00000100:00100000:0.0:1789265584.123978:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579033728 00000100:00100000:0.0:1789265584.123991:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789265584.123998:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180579033088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265584.124040:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180579033088:12345-0@lo:400:kworker.0 Request processed in 43us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265584.124047:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789265584.124062:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789265584.124068:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180579033600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265584.124094:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180579033600:12345-0@lo:400:kworker.0 Request processed in 26us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265584.124099:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789265584.124111:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1789265584.124127:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180579033216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265584.124156:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180579033216:12345-0@lo:400:kworker.0 Request processed in 30us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265584.124161:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1789265584.124172:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1789265584.124177:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180579033728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265584.124199:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180579033728:12345-0@lo:400:kworker.0 Request processed in 23us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265584.124204:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00010000:00080000:0.0:1789265584.124234:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f583100 x1876180579033216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265584.124245:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180579033216:0@lo:400:kworker.0 00010000:00080000:0.0:1789265584.124256:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774e40e300 x1876180579033728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265584.124264:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180579033728:0@lo:400:kworker.0 00000100:00100000:0.0:1789265584.124275:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180579033088:0@lo:400:kworker.0 00000100:00100000:0.0:1789265584.124283:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180579033600:0@lo:400:kworker.0 00000100:00100000:3.0:1789265584.124453:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579032960 00000100:00100000:3.0:1789265584.124458:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579032960 00000100:00100000:3.0:1789265584.124494:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789265584.124501:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579032960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265584.124544:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579032960:12345-0@lo:400:kworker.0 Request processed in 44us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265584.124550:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789265584.124612:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579032960:0@lo:400:kworker.0 00000100:00080000:2.0:1789265584.124929:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265584.124937:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265584.124940:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265584.124943:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265584.628338:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265584.628364:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579034112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265584.628438:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265584.628562:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579034112 00000100:00100000:2.0:1789265584.628582:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579034112 00000100:00100000:2.0:1789265584.628651:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789265584.628661:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579034112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265584.628693:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789265584.628740:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579034112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265584.628747:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789265584.629098:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579034112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265584.629238:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265584.629251:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579034240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265584.629283:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265584.629396:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579034240 00000100:00100000:1.0:1789265584.629401:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579034240 00000100:00100000:1.0:1789265584.629436:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789265584.629445:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579034240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789265584.629457:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789265584.629500:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579034240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265584.629507:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789265584.629607:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579034240:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789265584.691007:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265584.894035:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265584.894083:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265584.894116:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556958208 00000100:00100000:3.0:1789265584.894126:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265584.894128:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556958208 00000100:00100000:3.0:1789265584.894175:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556958464 00000100:00100000:3.0:1789265584.894180:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556958464 00000100:00100000:0.0:1789265584.894206:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 404 00000100:00100000:0.0:1789265584.894218:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:2400:x1876180556958208:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265584.894229:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556958336 00000100:00100000:3.0:1789265584.894234:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556958336 00000100:00100000:3.0:1789265584.894259:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 384 00000100:00100000:3.0:1789265584.894282:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556958464:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265584.894310:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63f6cd89-abac-4801-8de9-f59ae281263f+10:2400:x1876180556958208:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265584.894318:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 404 00000100:00100000:3.0:1789265584.894331:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2400:x1876180556958464:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 49us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265584.894340:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 384 00000100:00100000:3.0:1789265584.894358:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 385 00000100:00100000:3.0:1789265584.894366:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2400:x1876180556958336:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265584.894395:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2400:x1876180556958336:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 29us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265584.894402:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 385 00000100:00080000:2.0:1789265584.894593:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265584.894598:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1789265585.203722:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789265585.203732:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265585.205946:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1789265585.205984:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789265585.652547:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579034368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265585.652656:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265585.652923:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579034496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265585.652955:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265585.653053:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579034368 00000100:00100000:1.0:1789265585.653061:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579034368 00000100:00100000:1.0:1789265585.653112:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579034496 00000100:00100000:1.0:1789265585.653115:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579034496 00000100:00100000:1.0:1789265585.653131:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789265585.653139:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579034368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265585.653174:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789265585.653222:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579034368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265585.653228:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789265585.653245:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789265585.653251:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579034496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265585.653267:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789265585.653297:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579034496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265585.653320:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789265585.653453:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579034496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265585.653551:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579034368:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789265585.716040:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265585.780060:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789265585.822096:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265585.822345:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265585.822772:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265585.822791:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556958592 00000100:00100000:1.0:1789265585.822802:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556958592 00000100:00100000:1.0:1789265585.822906:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556958848 00000100:00100000:1.0:1789265585.822910:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556958848 00000100:00100000:1.0:1789265585.822938:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:1.0:1789265585.822948:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+11:2399:x1876180556958592:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265585.822962:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265585.822982:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937642392800/0xbbfdc9019c1d3ae7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91906b expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265585.823000:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265585.823057:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+10:2399:x1876180556958592:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 110us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265585.823065:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:1.0:1789265585.823083:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:1.0:1789265585.823090:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+9:2399:x1876180556958848:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265585.823097:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265585.823106:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9376435fca00/0xbbfdc9019c1d3cb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919128 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265585.823117:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265585.823134:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+8:2399:x1876180556958848:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 45us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265585.823154:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:1.0:1789265585.826417:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556958720 00000100:00100000:1.0:1789265585.826433:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556958720 00000100:00100000:1.0:1789265585.826825:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:1.0:1789265585.826839:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+8:2399:x1876180556958720:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265585.826892:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265585.826914:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937642392200/0xbbfdc9019c1d3aee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91909c expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265585.826932:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265585.827002:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63f6cd89-abac-4801-8de9-f59ae281263f+7:2399:x1876180556958720:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 167us (4230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265585.827010:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:0.0:1789265585.843852:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265585.843992:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556959104 00000100:00100000:1.0:1789265585.844003:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556959104 00000100:00100000:1.0:1789265585.844108:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 260 00000100:00100000:1.0:1789265585.844120:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+6:2396:x1876180556959104:12345-192.168.202.42@tcp:39:umount.0 00000020:00000080:1.0:1789265585.844175:0:6520:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3afc 00000020:00010000:1.0:1789265585.844183:0:6520:0:(genops.c:1921:obd_stale_export_put()) Put export ffff937643352800: total 0 00000100:00080000:1.0:1789265585.844188:0:6520:0:(import.c:65:import_set_state_nolock()) ffff937643350000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265585.844237:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1789265585.844419:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2396:x1876180556959104:12345-192.168.202.42@tcp:39:umount.0 Request processed in 301us (577us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1789265585.844427:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 260 00000020:00010000:2.0:1789265585.844568:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff937643352800: total 0 00010000:00010000:2.0:1789265585.844573:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265585.844639:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff937643352800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789265585.844683:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937779d97a00) 00010000:00010000:2.0:1789265585.844688:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265585.844697:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc600/0xbbfdc9019c1d4abc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919503 expref: 4 pid: 9988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265585.844725:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff937643352800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789265585.844737:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265585.844739:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265585.844741:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265585.860308:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265585.860557:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556959232 00000100:00100000:3.0:1789265585.860569:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556959232 00000100:00100000:3.0:1789265585.860711:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 261 00000100:00100000:3.0:1789265585.860723:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100bb9bf-f94c-48f4-a13a-604931ad9e86+5:2396:x1876180556959232:12345-192.168.202.42@tcp:39:umount.0 00000020:00000080:3.0:1789265585.860770:0:14174:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3b03 00000100:00080000:3.0:1789265585.860780:0:14174:0:(import.c:65:import_set_state_nolock()) ffff937643351000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265585.860814:0:14174:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789265585.861045:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100bb9bf-f94c-48f4-a13a-604931ad9e86+3:2396:x1876180556959232:12345-192.168.202.42@tcp:39:umount.0 Request processed in 323us (748us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789265585.861054:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 261 00010000:00010000:1.0:1789265585.861510:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265585.896007:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265585.896905:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556959488 00000100:00100000:2.0:1789265585.896918:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556959488 00000100:00100000:2.0:1789265585.896976:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 405 00000100:00100000:2.0:1789265585.896987:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937758355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+7:2396:x1876180556959488:12345-192.168.202.42@tcp:251:umount.0 00000020:00000080:2.0:1789265585.897036:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d39c1 00000020:00010000:2.0:1789265585.897044:0:6514:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9377582c1000: total 0 00000100:00080000:2.0:1789265585.897049:0:6514:0:(import.c:65:import_set_state_nolock()) ffff93777aaf2000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1789265585.897378:0:13735:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9377582c1000: total 0 00010000:00010000:3.0:1789265585.897435:0:13735:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9377582c1000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789265585.897468:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643219000/0xbbfdc9019c1d3a9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91905d expref: 3 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265585.897486:0:13735:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9377582c1000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789265585.897496:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265585.897499:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265585.897521:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265585.898352:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937758355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63f6cd89-abac-4801-8de9-f59ae281263f+1:2396:x1876180556959488:12345-192.168.202.42@tcp:251:umount.0 Request processed in 1362us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265585.898363:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 405 00000020:00000080:2.0:1789265585.898377:0:6514:0:(genops.c:885:class_export_put()) final put ffff9377582c1000/63f6cd89-abac-4801-8de9-f59ae281263f 00000020:00000080:0.0:1789265585.899359:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9377582c1000/63f6cd89-abac-4801-8de9-f59ae281263f for MGS 00000020:00000080:0.0:1789265585.899408:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93777aaf2000 for MGS 00000100:00100000:2.0:1789265586.163845:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265586.163928:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579034624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265586.164024:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265586.164120:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579034624 00000100:00100000:2.0:1789265586.164131:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579034624 00000100:00100000:2.0:1789265586.164211:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789265586.164223:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579034624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265586.164262:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789265586.164318:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579034624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265586.164327:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:2.0:1789265586.164355:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265586.164418:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579034624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265586.165344:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265586.165363:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579034752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265586.165418:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265586.166246:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579034752 00000100:00100000:3.0:1789265586.166258:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579034752 00000100:00100000:3.0:1789265586.166342:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789265586.166352:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579034752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265586.166380:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789265586.166580:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265586.169049:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579034752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2674us (3605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265586.169075:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789265586.175114:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579034752:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265586.742137:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265587.766758:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789265588.055067:0:15157:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789265588.069991:0:15157:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789265588.070058:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.070088:0:15157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.070095:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.070102:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.070129:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789265588.070134:0:15157:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789265588.070160:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265588.070164:0:15157:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789265588.070171:0:15157:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789265588.070198:0:15157:0:(import.c:65:import_set_state_nolock()) ffff937752853000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789265588.070224:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265588.070232:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265588.070240:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fcc00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265588.070243:0:13735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265588.070252:0:13735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265588.070259:0:13735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265588.070265:0:13735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789265588.070267:0:13735:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789265588.070276:0:13735:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789265588.070302:0:13735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265588.070309:0:13735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265588.070337:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265588.070345:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d3a69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3a70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265588.070358:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265588.070359:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265588.070362:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265588.070499:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180579035008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265588.070546:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180579034880:0@lo:39:umount.0 00000100:00100000:1.0:1789265588.070574:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265588.070579:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265588.071022:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579035008 00000100:00100000:2.0:1789265588.071029:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579035008 00000100:00100000:2.0:1789265588.071086:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265588.071582:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579034880 00000100:00100000:0.0:1789265588.071588:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579034880 00000100:00100000:2.0:1789265588.071681:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+24:3645:x1876180579035008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265588.071696:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265588.071714:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643218600/0xbbfdc9019c1d3a70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a69 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265588.071730:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265588.071787:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50e161d8-da73-42e3-8b96-d311cd2235de+23:3645:x1876180579035008:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265588.071839:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789265588.071845:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180579035008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265588.071846:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180579034880:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789265588.071885:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d35d8 00000100:00080000:0.0:1789265588.071894:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9377528e2800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789265588.073817:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3642:x1876180579034880:12345-0@lo:39:umount.0 Request processed in 1964us (3230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265588.073843:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1789265588.073871:0:6521:0:(genops.c:885:class_export_put()) final put ffff9377528e3000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1789265588.073953:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937752853000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789265588.073970:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180579034880:0@lo:39:umount.0 00000020:00000080:0.0:1789265588.074001:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9377528e3000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789265588.074060:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9377528e2800 for lustre-MDT0000 00010000:00010000:1.0:1789265588.077784:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265588.077890:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265588.077896:0:15157:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789265588.077903:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1789265588.079713:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1789265588.080037:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080052:0:15157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080068:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080075:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080102:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265588.080108:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080115:0:15157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080120:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080126:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080137:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789265588.080143:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080149:0:15157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080155:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080172:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080187:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789265588.080198:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789265588.080204:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080211:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bca00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265588.080215:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080224:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265588.080230:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265588.080236:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265588.080239:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789265588.080271:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080276:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265588.080303:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080309:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bca00/0xbbfdc9019c1d3a77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3a7e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265588.080320:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180579035136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265588.080331:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265588.080334:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080339:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167e800 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265588.080341:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080348:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265588.080353:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265588.080358:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265588.080359:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789265588.080362:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789265588.080374:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080379:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789265588.080384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265588.080392:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080397:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d397b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3982 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080405:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265588.080408:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080419:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd000 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265588.080422:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.080429:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265588.080435:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265588.080439:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789265588.080441:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789265588.080443:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789265588.080458:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265588.080563:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265588.080570:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265588.080582:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180579035264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265588.080689:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265588.080763:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579035136 00000100:00100000:2.0:1789265588.080770:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579035136 00000100:00100000:2.0:1789265588.080811:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579035264 00000100:00100000:2.0:1789265588.080814:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579035264 00000100:00100000:2.0:1789265588.080834:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265588.080843:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+24:3646:x1876180579035136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265588.080855:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265588.080886:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d3a7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a77 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265588.080915:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265588.080952:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+23:3646:x1876180579035136:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265588.080959:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265588.080975:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265588.080981:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+22:3644:x1876180579035264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265588.080987:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265588.080995:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93774167e000/0xbbfdc9019c1d3982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d397b expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265588.081003:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265588.081025:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+21:3644:x1876180579035264:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265588.081030:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265588.082305:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:50e161d8-da73-42e3-8b96-d311cd2235de:3644:1876180579035264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265588.082350:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265588.082384:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180579035136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265588.084695:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265588.084731:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.084738:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d3cd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3cdf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.084753:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265588.084756:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265588.084757:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265588.084781:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fd600/0xbbfdc9019c1d3537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.084790:0:15157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fd600/0xbbfdc9019c1d3537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.084807:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377413fd600/0xbbfdc9019c1d3537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.084814:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9377413fd600/0xbbfdc9019c1d3537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.084828:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789265588.084833:0:15157:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789265588.084839:0:15157:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1789265588.084898:0:15157:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789265588.084902:0:15157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789265588.084906:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265588.084912:0:15157:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1789265588.084919:0:15157:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93764278b000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789265588.084926:0:15157:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff937641a6c800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789265588.084930:0:15157:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9377778bd800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789265588.084934:0:15157:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93777786d000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1789265588.084941:0:15157:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff937643352800 100bb9bf-f94c-48f4-a13a-604931ad9e86 192.168.202.42@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789265588.084945:0:15157:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff937642769000 f16c02c5-6a63-4180-875a-2aaaca684c23 192.168.202.42@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1789265588.084949:0:15157:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff93775def4d28) has exports, disconnecting them 00000020:00080000:1.0:1789265588.084954:0:15157:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93764278b000), last request at 1789265584 00000020:00000080:1.0:1789265588.084960:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d38e8 00000100:00080000:1.0:1789265588.084977:0:15157:0:(import.c:65:import_set_state_nolock()) ffff93764278c800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789265588.085019:0:15157:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93764278b000): rc 0 00000020:00000080:1.0:1789265588.085022:0:15157:0:(genops.c:885:class_export_put()) final put ffff93764278b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789265588.085044:0:15157:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff937641a6c800), last request at 1789265584 00000020:00000080:1.0:1789265588.085048:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d37c2 00000100:00080000:1.0:1789265588.085053:0:15157:0:(import.c:65:import_set_state_nolock()) ffff937641a6b000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789265588.085066:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265588.085071:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377413fd600/0xbbfdc9019c1d3537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.085077:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fd600 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265588.085081:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377413fd600/0xbbfdc9019c1d3537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.085090:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377413fd600/0xbbfdc9019c1d3537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265588.085097:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377413fd600/0xbbfdc9019c1d3537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265588.085102:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265588.085104:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789265588.085107:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789265588.085138:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377413fd600/0xbbfdc9019c1d3537 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.085144:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265588.085158:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377413fd600/0xbbfdc9019c1d3537 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.085164:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377413fd600/0xbbfdc9019c1d3537 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d353e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265588.085175:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265588.085181:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265588.085183:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265588.085185:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265588.085197:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180579035520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265588.085197:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180579035392:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265588.085290:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789265588.085298:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93764278b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789265588.085345:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93764278c800 for lustre-MDT0000 00010000:00010000:2.0:1789265588.085375:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265588.085375:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265588.085402:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579035520 00000100:00100000:2.0:1789265588.085408:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579035520 00000020:00080000:1.0:1789265588.085424:0:15157:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff937641a6c800): rc 0 00000020:00000080:1.0:1789265588.085427:0:15157:0:(genops.c:885:class_export_put()) final put ffff937641a6c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1789265588.085434:0:15157:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9377778bd800), last request at 1789265334 00000020:00000080:1.0:1789265588.085438:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d36bf 00000100:00080000:1.0:1789265588.085443:0:15157:0:(import.c:65:import_set_state_nolock()) ffff9377778bc000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789265588.085454:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789265588.085461:0:15157:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9377778bd800): rc 0 00000020:00000080:1.0:1789265588.085463:0:15157:0:(genops.c:885:class_export_put()) final put ffff9377778bd800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1789265588.085468:0:15157:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93777786d000), last request at 1789265334 00000020:00000080:1.0:1789265588.085471:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3680 00000100:00080000:1.0:1789265588.085474:0:15157:0:(import.c:65:import_set_state_nolock()) ffff9377778ba800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265588.085482:0:15157:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1789265588.085560:0:15157:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93777786d000): rc 0 00000004:00000080:1.0:1789265588.085566:0:15157:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa60587b17ae0 00000100:00100000:2.0:1789265588.085795:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265588.085806:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377583d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+21:3645:x1876180579035520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265588.085818:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265588.085833:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937740031200/0xbbfdc9019c1d353e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3537 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265588.085845:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1789265588.085920:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789265588.085923:0:15157:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1789265588.085928:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377583d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50e161d8-da73-42e3-8b96-d311cd2235de+20:3645:x1876180579035520:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265588.085934:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000020:00000080:2.0:1789265588.085975:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff937641a6c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789265588.086001:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9377778bd800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789265588.086021:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937641a6b000 for lustre-MDT0000 00000020:00000080:2.0:1789265588.086025:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9377778bc000 for lustre-MDT0000 00010000:00010000:2.0:1789265588.086032:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265588.086230:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180579035520:0@lo:103:ldlm_bl.0 00000001:00100000:2.0:1789265588.087850:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789265588.087884:0:6497:0:(genops.c:885:class_export_put()) final put ffff93777786d000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789265588.087916:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 100bb9bf-f94c-48f4-a13a-604931ad9e86 00000001:00080000:2.0:1789265588.087932:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1789265588.087936:0:6497:0:(genops.c:885:class_export_put()) final put ffff937643352800/100bb9bf-f94c-48f4-a13a-604931ad9e86 00000001:00100000:2.0:1789265588.087943:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f16c02c5-6a63-4180-875a-2aaaca684c23 00000001:00080000:2.0:1789265588.087949:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1789265588.087982:0:6497:0:(genops.c:885:class_export_put()) final put ffff937642769000/f16c02c5-6a63-4180-875a-2aaaca684c23 00000020:00000080:2.0:1789265588.087997:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93777786d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789265588.088040:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff937643352800/100bb9bf-f94c-48f4-a13a-604931ad9e86 for lustre-MDT0000 00000020:00000080:2.0:1789265588.088062:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff937642769000/f16c02c5-6a63-4180-875a-2aaaca684c23 for lustre-MDT0000 00000020:00000080:2.0:1789265588.088091:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9377778ba800 for lustre-MDT0000 00000020:00000080:2.0:1789265588.088096:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937643350000 for lustre-MDT0000 00000020:00000080:2.0:1789265588.088099:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93764276f000 for lustre-MDT0000 00000100:00080000:1.0:1789265588.090991:0:15157:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789265588.091028:0:15157:0:(import.c:65:import_set_state_nolock()) ffff93777aaf6000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789265588.092583:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579035648:0@lo:39:umount.0 00000100:00080000:1.0:1789265588.092780:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789265588.092785:0:15157:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1789265588.092881:0:15157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789265588.092939:0:15157:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789265588.092960:0:15157:0:(import.c:65:import_set_state_nolock()) ffff937642504000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789265588.092971:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789265588.092985:0:15157:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1789265588.092994:0:15157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789265588.093050:0:15157:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789265588.093059:0:15157:0:(import.c:65:import_set_state_nolock()) ffff937642503800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789265588.093090:0:15157:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93775def4d28) has no exports 00000100:00100000:0.0:1789265588.093210:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265588.093259:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579035776:0@lo:9:umount.0 00000100:00100000:0.0:1789265588.093285:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265588.093301:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579035904:0@lo:9:umount.0 00000100:00100000:0.0:1789265588.093321:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265588.093341:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579035648 00000100:00100000:1.0:1789265588.093349:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579035648 00000100:00100000:1.0:1789265588.093392:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789265588.093400:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180579035648:12345-0@lo:39:umount.0 00000100:00100000:0.0:1789265588.093404:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1789265588.093428:0:6524:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d371a 00000100:00080000:1.0:1789265588.093437:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9377778b9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265588.093470:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1789265588.093507:0:14823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579035776 00000100:00100000:2.0:1789265588.093511:0:14823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579035776 00000100:00100000:2.0:1789265588.093543:0:14823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579035904 00000100:00100000:2.0:1789265588.093546:0:14823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579035904 00000100:00100000:2.0:1789265588.093570:0:14823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789265588.093578:0:14823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180579035776:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789265588.093668:0:14823:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d386a 00000100:00080000:2.0:1789265588.093675:0:14823:0:(import.c:65:import_set_state_nolock()) ffff9376420e1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265588.093711:0:14823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789265588.093816:0:14823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3642:x1876180579035776:12345-0@lo:9:umount.0 Request processed in 239us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265588.093823:0:14823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789265588.093839:0:14823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789265588.093844:0:14823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180579035904:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789265588.093856:0:14823:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d39ac 00000100:00080000:2.0:1789265588.093879:0:14823:0:(import.c:65:import_set_state_nolock()) ffff9376420e0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265588.094340:0:14823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789265588.094438:0:14823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3642:x1876180579035904:12345-0@lo:9:umount.0 Request processed in 593us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265588.094446:0:14823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789265588.094471:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265588.094484:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265588.094725:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937642504000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789265588.094735:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789265588.094737:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265588.094741:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579035776:0@lo:9:umount.0 00000100:00080000:2.0:1789265588.094754:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937642503800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789265588.094761:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789265588.094763:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265588.094765:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579035904:0@lo:9:umount.0 00010000:00010000:2.0:1789265588.094790:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265588.094989:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265588.095000:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265588.099546:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3642:x1876180579035648:12345-0@lo:39:umount.0 Request processed in 6138us (6641us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789265588.099562:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:2.0:1789265588.101631:0:3642:0:(import.c:65:import_set_state_nolock()) ffff93777aaf6000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789265588.101645:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579035648:0@lo:39:umount.0 00000001:00100000:2.0:1789265588.101689:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789265588.101694:0:9512:0:(genops.c:885:class_export_put()) final put ffff9376420e3800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789265588.101714:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f16c02c5-6a63-4180-875a-2aaaca684c23 00000020:00000080:2.0:1789265588.101716:0:9512:0:(genops.c:885:class_export_put()) final put ffff93777f39d000/f16c02c5-6a63-4180-875a-2aaaca684c23 00000001:00100000:2.0:1789265588.102268:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789265588.102272:0:8429:0:(genops.c:885:class_export_put()) final put ffff9376420e6000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789265588.102280:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f16c02c5-6a63-4180-875a-2aaaca684c23 00000020:00000080:2.0:1789265588.102282:0:8429:0:(genops.c:885:class_export_put()) final put ffff93777f39b800/f16c02c5-6a63-4180-875a-2aaaca684c23 00000100:00100000:0.0:1789265588.102389:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579035392 00000100:00100000:0.0:1789265588.102396:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579035392 00000100:00100000:0.0:1789265588.102663:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265588.102674:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+20:3643:x1876180579035392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265588.102688:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265588.102705:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643218400/0xbbfdc9019c1d3cdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3cd8 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265588.102731:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265588.102793:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50e161d8-da73-42e3-8b96-d311cd2235de+19:3643:x1876180579035392:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (9388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265588.102800:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:00000080:0.0:1789265588.103254:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9376420e3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789265588.103805:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93777f39d000/f16c02c5-6a63-4180-875a-2aaaca684c23 for lustre-OST0001 00000020:00000080:0.0:1789265588.103841:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9376420e6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789265588.103880:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93777f39b800/f16c02c5-6a63-4180-875a-2aaaca684c23 for lustre-OST0000 00000020:00000080:0.0:1789265588.103912:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9376420e0800 for lustre-OST0001 00000020:00000080:0.0:1789265588.103917:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9376436fd000 for lustre-OST0001 00000020:00000080:0.0:1789265588.103928:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9376420e1000 for lustre-OST0000 00000020:00000080:0.0:1789265588.103931:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93777f39c000 for lustre-OST0000 00000100:00100000:0.0:1789265588.104016:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180579035392:0@lo:103:ldlm_bl.0 00000001:00100000:3.0:1789265588.105903:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789265588.105918:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1789265588.105924:0:7450:0:(genops.c:885:class_export_put()) final put ffff93777aaf7800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789265588.105942:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 100bb9bf-f94c-48f4-a13a-604931ad9e86 00000001:00080000:3.0:1789265588.105947:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1789265588.105949:0:7450:0:(genops.c:885:class_export_put()) final put ffff937643355000/100bb9bf-f94c-48f4-a13a-604931ad9e86 00000001:00100000:3.0:1789265588.105954:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f16c02c5-6a63-4180-875a-2aaaca684c23 00000001:00080000:3.0:1789265588.105957:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1789265588.105959:0:7450:0:(genops.c:885:class_export_put()) final put ffff93777786c800/f16c02c5-6a63-4180-875a-2aaaca684c23 00000020:00000080:0.0:1789265588.106036:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93777aaf7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789265588.106094:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff937643355000/100bb9bf-f94c-48f4-a13a-604931ad9e86 for lustre-MDT0001 00000020:00000080:0.0:1789265588.106117:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93777786c800/f16c02c5-6a63-4180-875a-2aaaca684c23 for lustre-MDT0001 00000020:00000080:0.0:1789265588.106141:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9377778b9000 for lustre-MDT0001 00000020:00000080:0.0:1789265588.106157:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937643351000 for lustre-MDT0001 00000020:00000080:0.0:1789265588.106161:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93777f36b800 for lustre-MDT0001 00000020:00080000:1.0:1789265588.114807:0:15157:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93775def4d28) has no exports 00000020:00000080:1.0:1789265588.208428:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3592 00000020:00000080:1.0:1789265588.208452:0:15157:0:(genops.c:885:class_export_put()) final put ffff93777a3b3000/lustre-QMT0000_UUID 00000020:01000000:1.0:1789265588.208545:0:15157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789265588.208663:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93777a3b3000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789265588.208694:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265588.208707:0:15157:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789265588.208713:0:15157:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff93775f6899b8) has no exports 00000020:00000080:2.0:1789265588.209943:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d358b 00000020:00000080:2.0:1789265588.209959:0:15157:0:(genops.c:885:class_export_put()) final put ffff93777a3b0000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789265588.211890:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93777a3b0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789265588.212341:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265588.212357:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789265588.212363:0:15157:0:(genops.c:885:class_export_put()) final put ffff9377442c6000/lustre-QMT0000_UUID 00000020:00000080:3.0:1789265588.212367:0:15157:0:(genops.c:844:class_export_destroy()) destroying export ffff9377442c6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789265588.212372:0:15157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1789265588.212561:0:15157:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff937641b8ba80 - data ffff937641c46ca8/ffff937643345800 00000020:01000000:3.0:1789265588.212740:0:15157:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff937772d69ae0 - data ffff93777354fe58/ffff93774d945800 00000001:00000004:3.0:1789265588.231327:0:15157:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1789265588.302804:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789265588.302837:0:15157:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789265588.302878:0:15157:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff93774f15aa00 x1876180579035648/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789265598 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265588.302914:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789265588.308833:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789265588.308844:0:15157:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1789265588.308976:0:15157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265588.308980:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789265588.310342:0:8711:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789265588.310351:0:8711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1789265588.310365:0:8711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789265588.311314:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789265588.311321:0:15157:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1789265588.311346:0:15157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265588.311350:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789265588.311711:0:9784:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789265588.311718:0:9784:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1789265588.311730:0:9784:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789265588.314404:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d355a 00000020:00000080:2.0:1789265588.314425:0:15157:0:(genops.c:885:class_export_put()) final put ffff9377528e5000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789265588.315531:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9377528e5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789265588.318095:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d356f 00000020:00000080:2.0:1789265588.318113:0:15157:0:(genops.c:885:class_export_put()) final put ffff9377528e4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789265588.318129:0:15157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789265588.318134:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265588.318144:0:15157:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789265588.318149:0:15157:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff93775def3370) has no exports 00000004:01000000:2.0:1789265588.318362:0:15157:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789265588.318374:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d39a5 00000020:00000080:2.0:1789265588.318379:0:15157:0:(genops.c:885:class_export_put()) final put ffff9376436f8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789265588.318384:0:15157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789265588.318387:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265588.318399:0:15157:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789265588.318401:0:15157:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9376424f19b8) has no exports 00000020:00000080:2.0:1789265588.318410:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d399e 00000020:00000080:2.0:1789265588.318415:0:15157:0:(genops.c:885:class_export_put()) final put ffff937642501800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1789265588.318803:0:15157:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789265588.318809:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789265588.318829:0:15157:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1789265588.318838:0:15157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265588.318841:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789265588.318909:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265588.318920:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789265588.318926:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3863 00000020:00000080:2.0:1789265588.318931:0:15157:0:(genops.c:885:class_export_put()) final put ffff93764213b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789265588.318935:0:15157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789265588.318939:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265588.318942:0:15157:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789265588.318945:0:15157:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9376424f4d28) has no exports 00000020:00000080:2.0:1789265588.318949:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d385c 00000020:00000080:2.0:1789265588.318952:0:15157:0:(genops.c:885:class_export_put()) final put ffff937642506000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1789265588.319319:0:15157:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789265588.319323:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789265588.319325:0:15157:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1789265588.319329:0:15157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265588.319331:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789265588.319358:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265588.319364:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1789265588.319377:0:15157:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789265588.319383:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3713 00000020:00000080:2.0:1789265588.319389:0:15157:0:(genops.c:885:class_export_put()) final put ffff93774f068000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789265588.319393:0:15157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1789265588.319397:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265588.319401:0:15157:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789265588.319403:0:15157:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff93774f188000) has no exports 00000020:00000080:2.0:1789265588.319408:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d370c 00000020:00000080:2.0:1789265588.319410:0:15157:0:(genops.c:885:class_export_put()) final put ffff93777aaf4800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789265588.320781:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9377528e4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1789265588.320803:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9376436f8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789265588.320809:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff937642501800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789265588.320817:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937642503800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789265588.320827:0:37:0:(genops.c:885:class_export_put()) final put ffff9376431dc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789265588.320830:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9376431dc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789265588.320835:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265588.320969:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93764213b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789265588.320992:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff937642506000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789265588.320997:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937642504000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789265588.321003:0:37:0:(genops.c:885:class_export_put()) final put ffff937641a6f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789265588.321005:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff937641a6f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789265588.321009:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265588.321039:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93774f068000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789265588.321044:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93777aaf4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789265588.321077:0:15157:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1789265588.321083:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789265588.321087:0:15157:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1789265588.321095:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789265588.321121:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93777aaf6000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789265588.321164:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265588.321177:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265588.321182:0:15157:0:(genops.c:885:class_export_put()) final put ffff937752854000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789265588.321184:0:15157:0:(genops.c:844:class_export_destroy()) destroying export ffff937752854000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1789265588.321191:0:15157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265588.321252:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265588.321258:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265588.321261:0:15157:0:(genops.c:885:class_export_put()) final put ffff9377528e2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789265588.321263:0:15157:0:(genops.c:844:class_export_destroy()) destroying export ffff9377528e2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789265588.321266:0:15157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265588.321329:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3576 00000020:00000080:3.0:1789265588.321338:0:15157:0:(genops.c:885:class_export_put()) final put ffff9377528e5800/lustre-MDD0000_UUID 00000020:01000000:3.0:1789265588.321346:0:15157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789265588.321354:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9377528e5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789265588.321362:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265588.321367:0:15157:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789265588.321377:0:15157:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff93775def19b8) has no exports 00000020:00000080:3.0:1789265588.321405:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265588.321409:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789265588.321412:0:15157:0:(genops.c:885:class_export_put()) final put ffff9377528e7000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789265588.321414:0:15157:0:(genops.c:844:class_export_destroy()) destroying export ffff9377528e7000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789265588.321418:0:15157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789265588.321446:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d357d 00000020:00000080:3.0:1789265588.321451:0:15157:0:(genops.c:885:class_export_put()) final put ffff9377528e4000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789265588.321464:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9377528e4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:3.0:1789265588.321477:0:15157:0:(tgt_mount.c:187:server_put_mount()) put mount ffff937779e62800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789265588.321481:0:15157:0:(obd_mount.c:710:lustre_put_lsi()) put ffff937779e62800 3 00000020:01000004:3.0:1789265588.321485:0:15157:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff937779e62800 from lustre-MDT0000 00000020:00000080:3.0:1789265588.321506:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265588.321510:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789265588.321513:0:15157:0:(genops.c:885:class_export_put()) final put ffff9377528e0000/lustre-MDT0000_UUID 00000020:00000080:3.0:1789265588.321515:0:15157:0:(genops.c:844:class_export_destroy()) destroying export ffff9377528e0000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789265588.321522:0:15157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789265588.321548:0:15157:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1789265588.321553:0:15157:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789265588.321556:0:15157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789265588.321559:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265588.321562:0:15157:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789265588.321569:0:15157:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff937779e23800 50e161d8-da73-42e3-8b96-d311cd2235de 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789265588.321575:0:15157:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff93775f5419b8) has exports, disconnecting them 00000020:00080000:3.0:1789265588.321580:0:15157:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff937779e23800), last request at 1789265315 00000020:00000080:3.0:1789265588.321614:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d351b 00000020:00010000:3.0:1789265588.321619:0:15157:0:(genops.c:1921:obd_stale_export_put()) Put export ffff937779e23800: total 0 00000100:00080000:3.0:1789265588.321624:0:15157:0:(import.c:65:import_set_state_nolock()) ffff937779e27800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789265588.321639:0:15157:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff937779e23800): rc 0 00000020:00080000:3.0:1789265588.321644:0:15157:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff93775f5419b8) has no exports 00000020:00010000:3.0:1789265588.321695:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff937779e23800: total 0 00010000:00010000:3.0:1789265588.321726:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff937779e23800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789265588.321763:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643219200/0xbbfdc9019c1d3cc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3cbc expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265588.321783:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bc400/0xbbfdc9019c1d3a54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a4d expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265588.321794:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937740031000/0xbbfdc9019c1d3cd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3cca expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265588.321805:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937642392a00/0xbbfdc9019c1d3a46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a3f expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265588.321816:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643219400/0xbbfdc9019c1d3cae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3ca7 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265588.321830:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643218e00/0xbbfdc9019c1d3a62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a5b expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265588.321840:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937740031e00/0xbbfdc9019c1d3617 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3610 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265588.321853:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377413fc000/0xbbfdc9019c1d3625 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d361e expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265588.321899:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643219800/0xbbfdc9019c1d3a8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a85 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265588.321911:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937642393e00/0xbbfdc9019c1d3a1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a15 expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265588.321921:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bce00/0xbbfdc9019c1d3a2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a23 expref: 4 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265588.321941:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377413fca00/0xbbfdc9019c1d393c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3935 expref: 3 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265588.321952:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937643219e00/0xbbfdc9019c1d3a38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbbfdc9019c1d3a31 expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265588.321962:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff937779e23800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1789265588.321976:0:6507:0:(genops.c:885:class_export_put()) final put ffff937779e23800/50e161d8-da73-42e3-8b96-d311cd2235de 00010000:00010000:3.0:1789265588.321987:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265588.321990:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265588.321991:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789265588.321997:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff937779e23800/50e161d8-da73-42e3-8b96-d311cd2235de for MGS 00000020:00000080:3.0:1789265588.322021:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937779e27800 for MGS 00000100:00100000:3.0:1789265588.322070:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff937747982e00:6514] 2 exiting: rc = 0 00000100:00100000:3.0:1789265588.322206:0:6512:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff937747983400:6512] 0 exiting: rc = 1 00000100:00100000:3.0:1789265588.322274:0:6513:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff937747982800:6513] 1 exiting: rc = 0 00000100:00100000:3.0:1789265588.322348:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322358:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322364:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322372:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322378:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322387:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322393:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322399:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322405:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322412:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322419:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322427:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322434:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322441:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322456:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322462:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322468:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322475:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322482:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322489:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322494:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322501:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322508:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322515:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322522:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322528:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322533:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322540:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322546:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322554:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322560:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322567:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322573:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322580:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322588:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322605:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322613:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322620:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322625:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322632:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322638:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322644:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322650:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322655:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322661:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322667:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322672:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322678:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322684:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322698:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322704:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322710:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322717:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322724:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322729:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322735:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322743:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322749:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322756:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322761:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322767:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322773:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322779:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265588.322784:0:15157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1789265588.333497:0:15157:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff937643375060 - data ffff937641d21ca8/ffff93774f3b9000 00000020:01000000:3.0:1789265588.333712:0:15157:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93775de76960 - data ffff937773479288/ffff937779de6800 00000020:00000080:3.0:1789265588.335231:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d34ff 00000020:00000080:3.0:1789265588.335249:0:15157:0:(genops.c:885:class_export_put()) final put ffff937760303000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789265588.335281:0:15157:0:(tgt_mount.c:187:server_put_mount()) put mount ffff937779e62800 from MGS, refs=2 00000020:01000004:3.0:1789265588.335286:0:15157:0:(obd_mount.c:710:lustre_put_lsi()) put ffff937779e62800 2 00000020:01000004:3.0:1789265588.335289:0:15157:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff937779e62800 from MGS 00000020:00000080:3.0:1789265588.335320:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265588.335328:0:15157:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789265588.335331:0:15157:0:(genops.c:885:class_export_put()) final put ffff937744f35800/MGS 00000020:00000080:3.0:1789265588.335334:0:15157:0:(genops.c:844:class_export_destroy()) destroying export ffff937744f35800/MGS for MGS 00000020:01000000:3.0:1789265588.335343:0:15157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789265588.335444:0:15157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789265588.335450:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265588.335458:0:15157:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789265588.335467:0:15157:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff937752852000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789265588.335474:0:15157:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff93775f543370) has exports, disconnecting them 00000020:00080000:3.0:1789265588.335479:0:15157:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff937752852000), last request at 1789265315 00000020:00000080:3.0:1789265588.335502:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d35ca 00000020:00080000:3.0:1789265588.335517:0:15157:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff937752852000): rc 0 00000020:00000080:3.0:1789265588.335523:0:15157:0:(genops.c:885:class_export_put()) final put ffff937752852000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789265588.336413:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff937760303000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789265588.336429:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff937752852000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789265588.372932:0:15157:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789265588.372943:0:15157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265588.372958:0:15157:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789265588.372966:0:15157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789265588.373008:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937752853000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789265588.373209:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265588.373221:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789265588.373228:0:15157:0:(genops.c:885:class_export_put()) final put ffff937752851800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789265588.373233:0:15157:0:(genops.c:844:class_export_destroy()) destroying export ffff937752851800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789265588.373247:0:15157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789265588.373356:0:15157:0:(obd_mount.c:710:lustre_put_lsi()) put ffff937779e62800 1 00000020:00000080:1.0:1789265588.373364:0:15157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d34f1 00000020:00000080:1.0:1789265588.373371:0:15157:0:(genops.c:885:class_export_put()) final put ffff937744f33000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789265588.373379:0:15157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789265588.373385:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff937744f33000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789265588.373392:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265588.373397:0:15157:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789265588.373400:0:15157:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff93775def0000) has no exports 00000020:00000080:2.0:1789265588.479648:0:15157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265588.479968:0:15157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789265588.479976:0:15157:0:(genops.c:885:class_export_put()) final put ffff937779e61800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789265588.479997:0:15157:0:(genops.c:844:class_export_destroy()) destroying export ffff937779e61800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789265588.480005:0:15157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789265588.480272:0:15157:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff937779e63800 00000020:02000400:2.0:1789265588.480353:0:15157:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789265588.791493:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265589.240187:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180579036032:0@lo:400:kworker.0 00000400:00000100:0.0:1789265589.240262:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180579036032 offset 0 length 224: 4 00000100:00100000:0.0:1789265589.240325:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180579036544:0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.240366:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265589.240392:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579037056:0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.240443:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265589.240473:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789265589.240480:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180579036416:0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.240505:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265589.240523:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180579036928:0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.240545:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265589.240576:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579036160:0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.240622:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265589.240642:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579036672:0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.240665:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265589.240698:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789265589.240704:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180579036288:0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.240730:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265589.240747:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180579036800:0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.240769:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265589.240807:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579036544 00000100:00100000:0.0:1789265589.240817:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579036544 00000100:00100000:0.0:1789265589.240924:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579036416 00000100:00100000:0.0:1789265589.240927:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579036416 00000100:00100000:0.0:1789265589.240940:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579036928 00000100:00100000:0.0:1789265589.240942:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579036928 00000100:00100000:0.0:1789265589.240957:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579036288 00000100:00100000:0.0:1789265589.240959:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579036288 00000100:00100000:0.0:1789265589.240966:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579036800 00000100:00100000:0.0:1789265589.240968:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579036800 00000100:00100000:0.0:1789265589.240981:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1789265589.240991:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180579036544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.241066:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180579036544:12345-0@lo:400:kworker.0 Request processed in 76us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265589.241075:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1789265589.241095:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789265589.241102:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180579036928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.241130:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180579036928:12345-0@lo:400:kworker.0 Request processed in 28us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265589.241136:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789265589.241148:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789265589.241152:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1876180579036416:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789265589.241158:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789265589.241182:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1876180579036416:12345-0@lo:400:kworker.0 Request processed in 29us (677us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265589.241188:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789265589.241200:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789265589.241204:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876180579036288:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789265589.241208:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789265589.241232:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876180579036288:12345-0@lo:400:kworker.0 Request processed in 27us (502us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265589.241238:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789265589.241248:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789265589.241252:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876180579036800:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789265589.241256:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789265589.241278:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876180579036800:12345-0@lo:400:kworker.0 Request processed in 24us (508us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265589.241284:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789265589.241313:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579037056 00000100:00100000:0.0:1789265589.241317:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579037056 00000100:00100000:0.0:1789265589.241350:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579036672 00000100:00100000:0.0:1789265589.241353:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579036672 00000100:00100000:0.0:1789265589.241374:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789265589.241381:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579037056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.241414:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579037056:12345-0@lo:400:kworker.0 Request processed in 34us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265589.241421:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789265589.241433:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789265589.241438:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579036672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.241466:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579036672:12345-0@lo:400:kworker.0 Request processed in 28us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265589.241472:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789265589.241499:0:10357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579036160 00000100:00100000:0.0:1789265589.241503:0:10357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579036160 00000100:00100000:0.0:1789265589.241530:0:10357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789265589.241535:0:10357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876180579036160:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789265589.241540:0:10357:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789265589.241563:0:10357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876180579036160:12345-0@lo:400:kworker.0 Request processed in 28us (941us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265589.241569:0:10357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:0.0:1789265589.241609:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265589.241614:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265589.241617:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265589.241648:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265589.241655:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9376420e2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789265589.241660:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789265589.267413:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9376420e2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265589.267432:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 215 00000100:00080000:0.0:1789265589.267444:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9376420e2800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265589.267498:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37e680 x1876180579037184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265589.267542:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180579036416:0@lo:400:kworker.0 00010000:00080000:0.0:1789265589.267601:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff93774f37d180 x1876180579036928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265589.267616:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180579036928:0@lo:400:kworker.0 00010000:00080000:0.0:1789265589.267636:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff93774f37c380 x1876180579036544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265589.267645:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180579036544:0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.267662:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579037056:0@lo:400:kworker.0 00000100:00080000:0.0:1789265589.268925:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265589.268933:0:3643:0:(import.c:65:import_set_state_nolock()) ffff937752850000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789265589.268938:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789265589.268943:0:3643:0:(import.c:65:import_set_state_nolock()) ffff937752850000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265589.268948:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 190 00000100:00080000:0.0:1789265589.268957:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff937752850000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265589.268985:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37e300 x1876180579037312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265589.269001:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180579036288:0@lo:400:kworker.0 00000100:00080000:0.0:1789265589.269026:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265589.269030:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9376420e7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789265589.269033:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789265589.269036:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9376420e7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265589.269039:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 240 00000100:00080000:0.0:1789265589.269044:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9376420e7000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265589.269056:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37c380 x1876180579037440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265589.269066:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180579036800:0@lo:400:kworker.0 00000100:00080000:0.0:1789265589.269081:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265589.269083:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9377778bf800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789265589.269086:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789265589.269091:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9377778bf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265589.269093:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 190 00000100:00080000:0.0:1789265589.269098:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9377778bf800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265589.269108:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37d180 x1876180579037568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265589.269116:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579036160:0@lo:400:kworker.0 00000100:00100000:0.0:1789265589.269135:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579036672:0@lo:400:kworker.0 00000100:00100000:3.0:1789265589.269567:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180579037184:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789265589.269683:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265589.269718:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180579037312:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789265589.269741:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265589.269757:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180579037440:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789265589.269779:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265589.269796:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579037568:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789265589.269821:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265589.269889:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579037568 00000100:00100000:3.0:1789265589.269899:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579037568 00000100:00100000:3.0:1789265589.269941:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789265589.269950:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876180579037568:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1789265589.269975:0:6524:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789265589.270035:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876180579037568:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 83us (211us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789265589.270044:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:3.0:1789265589.270096:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9377778bf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789265589.270101:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789265589.270105:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579037568:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789265589.270297:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579037184 00000100:00100000:0.0:1789265589.270302:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579037184 00000100:00100000:0.0:1789265589.270334:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579037312 00000100:00100000:0.0:1789265589.270351:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579037312 00000100:00100000:0.0:1789265589.270369:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579037440 00000100:00100000:0.0:1789265589.270372:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579037440 00000100:00100000:0.0:1789265589.270382:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789265589.270387:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180579037184:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1789265589.270399:0:6520:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789265589.270434:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180579037184:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 46us (752us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789265589.270440:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789265589.270452:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789265589.270456:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180579037312:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1789265589.270464:0:6520:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789265589.270485:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180579037312:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 28us (743us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789265589.270490:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789265589.270500:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789265589.270504:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180579037440:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1789265589.270511:0:6520:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789265589.270530:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180579037440:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 24us (750us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789265589.270535:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1789265589.270571:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376420e2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265589.270576:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265589.271757:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180579037184:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1789265589.271792:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937752850000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265589.271805:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265589.271809:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180579037312:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1789265589.271823:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376420e7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265589.271827:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265589.271830:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180579037440:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789265589.751413:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579037696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265589.751506:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265589.751979:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579037696 00000100:00100000:0.0:1789265589.751988:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579037696 00000100:00100000:0.0:1789265589.752038:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789265589.752047:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579037696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265589.752074:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789265589.752118:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579037696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265589.752125:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789265589.787333:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579037696:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789265589.822219:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265590.840197:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265591.290911:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579037824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265591.291040:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265591.295082:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579037824 00000100:00100000:3.0:1789265591.295112:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579037824 00000100:00100000:3.0:1789265591.295209:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789265591.295222:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579037824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265591.295265:0:13004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789265591.295378:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579037824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (4337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265591.295386:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789265591.295482:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579037824:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789265591.295700:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789265591.864167:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265592.885279:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789265593.803298:0:15357:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789265593.846401:0:15357:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789265593.847659:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.847682:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.847690:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.847698:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.847726:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789265593.847732:0:15357:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789265593.849142:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265593.849154:0:15357:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789265593.849166:0:15357:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789265593.849175:0:15357:0:(import.c:65:import_set_state_nolock()) ffff937752850000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789265593.849184:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265593.849186:0:15357:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789265593.849213:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789265593.850353:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265593.850369:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265593.850383:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392400 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:3.0:1789265593.850388:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265593.850399:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265593.850406:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265593.850412:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789265593.850415:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789265593.850419:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789265593.850488:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265593.850495:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265593.850613:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265593.850621:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937642392400/0xbbfdc9019c1d3a4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3a54 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265593.850641:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265593.850643:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265593.850645:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265593.850670:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180579037952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265593.850934:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265593.851048:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579037952 00000100:00100000:3.0:1789265593.851057:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579037952 00000100:00100000:3.0:1789265593.851108:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789265593.851117:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1876180579037952:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789265593.851136:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265593 with bad export cookie 13546204262951630107 00010000:00010000:2.0:1789265593.858406:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.858435:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.858443:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.858451:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.858489:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265593.858497:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.858505:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.858512:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.858519:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.860674:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789265593.860705:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.860718:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.860748:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.860755:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872246:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789265593.872271:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872287:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393a00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:0.0:1789265593.872291:0:13735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872303:0:13735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265593.872310:0:13735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265593.872342:0:13735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789265593.872345:0:13735:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1789265593.872401:0:13735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872408:0:13735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265593.872447:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872455:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937642393a00/0xbbfdc9019c1d3a5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3a62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872478:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265593.872483:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872489:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167fa00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:0.0:1789265593.872493:0:13735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872499:0:13735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265593.872506:0:13735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265593.872513:0:13735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789265593.872516:0:13735:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789265593.872519:0:13735:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789265593.872542:0:13735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872558:0:13735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265593.872577:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872584:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff93774167fa00/0xbbfdc9019c1d3935 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d393c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872602:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265593.872607:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872613:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fce00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:0.0:1789265593.872616:0:13735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872622:0:13735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265593.872628:0:13735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265593.872632:0:13735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789265593.872634:0:13735:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789265593.872646:0:13735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872652:0:13735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265593.872657:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265593.872674:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265593.872676:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265593.872679:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265593.872713:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180579038208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265593.872946:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265593.872999:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265593.873006:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180579038336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265593.873029:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265593.873074:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579038208 00000100:00100000:0.0:1789265593.873082:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579038208 00000100:00100000:0.0:1789265593.873129:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579038336 00000100:00100000:0.0:1789265593.873132:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579038336 00000100:00100000:0.0:1789265593.873147:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265593.873155:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1876180579038208:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789265593.873162:0:6504:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265593 with bad export cookie 13546204262951630107 00000100:00100000:0.0:1789265593.873212:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1876180579038208:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (267us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265593.873220:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265593.873240:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789265593.873244:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1876180579038336:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789265593.873248:0:6504:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265593 with bad export cookie 13546204262951630107 00000100:00100000:0.0:1789265593.873273:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1876180579038336:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (244us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265593.873279:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789265593.873314:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.142@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265593.873320:0:3643:0:(import.c:65:import_set_state_nolock()) ffff937779e27000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789265593.873331:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1789265593.877208:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789265593.877230:0:15357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9376435fce00/0xbbfdc9019c1d3cca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3cd1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265593.877257:0:15357:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789265593.877335:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d361e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.877344:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d361e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.877351:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d361e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.877357:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d361e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265593.877382:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789265593.877387:0:15357:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1789265593.877390:0:15357:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1789265593.877441:0:15357:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1789265593.877517:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1789265593.877524:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265593.877560:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789265593.877570:0:15357:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff93764276c800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789265593.877576:0:15357:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff937641a6f000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789265593.877581:0:15357:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9377778c0000) has exports, disconnecting them 00000020:00080000:2.0:1789265593.877586:0:15357:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93764276c800), last request at 1789265589 00000020:00000080:2.0:1789265593.877594:0:15357:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d38fd 00000100:00080000:2.0:1789265593.877616:0:15357:0:(import.c:65:import_set_state_nolock()) ffff93764276d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789265593.877670:0:15357:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93764276c800): rc 0 00000020:00000080:2.0:1789265593.877673:0:15357:0:(genops.c:885:class_export_put()) final put ffff93764276c800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1789265593.877687:0:15357:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff937641a6f000), last request at 1789265589 00000020:00000080:2.0:1789265593.877691:0:15357:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d37d7 00000100:00080000:2.0:1789265593.877697:0:15357:0:(import.c:65:import_set_state_nolock()) ffff93774e41e000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789265593.877704:0:15357:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff937641a6f000): rc 0 00000020:00000080:2.0:1789265593.877706:0:15357:0:(genops.c:885:class_export_put()) final put ffff937641a6f000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1789265593.877715:0:15357:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa605815bbae0 00000100:00080000:2.0:1789265593.877739:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265593.877744:0:15357:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1789265593.880389:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265593.880405:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d361e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265593.880418:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc000 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265593.880423:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d361e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265593.880435:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d361e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265593.882153:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d361e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265593.882160:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265593.882164:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789265593.882168:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:2.0:1789265593.889291:0:15357:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789265593.889303:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9377778bf800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789265593.889468:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789265593.889473:0:15357:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1789265593.889487:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789265593.889563:0:15357:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789265593.889591:0:15357:0:(import.c:65:import_set_state_nolock()) ffff93764213c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789265593.889609:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789265593.889612:0:15357:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1789265593.889622:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265593.889693:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579038464:0@lo:9:umount.0 00000100:00100000:2.0:1789265593.889776:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265593.889837:0:9789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579038464 00000100:00100000:2.0:1789265593.889846:0:9789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579038464 00000100:00100000:2.0:1789265593.889918:0:9789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789265593.889928:0:9789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180579038464:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789265593.889952:0:9789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3824 00000100:00080000:2.0:1789265593.889960:0:9789:0:(import.c:65:import_set_state_nolock()) ffff9376420e4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265593.889992:0:9789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789265593.890127:0:9789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3642:x1876180579038464:12345-0@lo:9:umount.0 Request processed in 200us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265593.890135:0:9789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1789265593.890154:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265593.890185:0:3642:0:(import.c:65:import_set_state_nolock()) ffff93764213c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789265593.890192:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789265593.890194:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265593.890197:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579038464:0@lo:9:umount.0 00000100:00080000:2.0:1789265593.890219:0:15357:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789265593.890230:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9376420e7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789265593.890246:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579038592:0@lo:9:umount.0 00000100:00100000:2.0:1789265593.890272:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265593.890300:0:14823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579038592 00000100:00100000:2.0:1789265593.890304:0:14823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579038592 00000100:00100000:2.0:1789265593.890333:0:14823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789265593.890339:0:14823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377812acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180579038592:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789265593.890351:0:14823:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3974 00000100:00080000:2.0:1789265593.890356:0:14823:0:(import.c:65:import_set_state_nolock()) ffff937642788800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265593.890373:0:14823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789265593.890459:0:14823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377812acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3642:x1876180579038592:12345-0@lo:9:umount.0 Request processed in 119us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265593.890466:0:14823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789265593.890639:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265593.890658:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376420e7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789265593.890665:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789265593.890666:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265593.890669:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579038592:0@lo:9:umount.0 00000020:00080000:2.0:1789265593.890703:0:15357:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9377778c0000) has no exports 00010000:00010000:2.0:1789265593.895218:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265593.896512:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1876180579037952:12345-0@lo:103:ldlm_bl.0 Request processed in 45196us (45379us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789265593.896530:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789265593.897227:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.142@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265593.905491:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.142@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789265593.905500:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789265593.905512:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93774e40c700 x1876180579036032/t0(0) o400->MGC192.168.202.142@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789265605 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265593.905533:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9376434d6680 x1876180579037952/t0(0) o103->MGC192.168.202.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265609 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265593.905560:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93774f37e300 x1876180579038208/t0(0) o103->MGC192.168.202.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265609 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265593.905570:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93774f37e680 x1876180579038336/t0(0) o103->MGC192.168.202.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265609 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789265593.905580:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789265593.905583:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789265593.905585:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789265593.905661:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:0:1876180579038080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265593.905693:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:3646:1876180579036032:0@lo:400:kworker.0 00000100:00080000:2.0:1789265593.906231:0:3645:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff937779e27000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1789265593.906248:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:50e161d8-da73-42e3-8b96-d311cd2235de:3645:1876180579037952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265593.906627:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d361e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265593.906644:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1789265593.906722:0:3643:0:(import.c:65:import_set_state_nolock()) ffff937779e27000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265593.906731:0:3643:0:(import.c:510:import_select_connection()) MGC192.168.202.142@tcp: connect to NID 0@lo last attempt 171 00000100:00080000:0.0:1789265593.906742:0:3643:0:(import.c:624:import_select_connection()) MGC192.168.202.142@tcp: import ffff937779e27000 using connection 192.168.202.142@tcp/0@lo 00010000:00010000:1.0:1789265593.907114:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d361e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265593.907188:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d361e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbbfdc9019c1d3625 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265593.907219:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265593.907221:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265593.907224:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789265593.907354:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93764276c800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1789265593.907626:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff937641a6f000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789265593.907706:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93764276d800 for lustre-MDT0001 00000020:00000080:0.0:1789265593.907712:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93774e41e000 for lustre-MDT0001 00010000:00010000:0.0:1789265593.907728:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265593.907769:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37ed80 x1876180579038848/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265593.907834:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180579038208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265593.907882:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:50e161d8-da73-42e3-8b96-d311cd2235de:3643:1876180579038336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265593.908716:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265593.908740:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:50e161d8-da73-42e3-8b96-d311cd2235de:0:1876180579038720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265593.908748:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:50e161d8-da73-42e3-8b96-d311cd2235de:3642:1876180579038848:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1789265593.908827:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180579038848 offset 0 length 520: 4 00010000:00010000:2.0:1789265593.914300:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789265593.917411:0:15357:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9377778c0000) has no exports 00000020:01000000:2.0:1789265593.991819:0:15357:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff937641b8b4e0 - data ffff9377735925e8/ffff937643345c00 00000020:01000000:2.0:1789265593.992071:0:15357:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9377460db000 - data ffff937773592bd0/ffff93777a988000 00000001:00000004:2.0:1789265594.015142:0:15357:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1789265594.101727:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265594.101737:0:15357:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1789265594.101746:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789265594.106856:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789265594.106900:0:15357:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1789265594.106925:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265594.106929:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789265594.108005:0:8707:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789265594.108014:0:8707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1789265594.108027:0:8707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789265594.108629:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789265594.108646:0:15357:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1789265594.108666:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789265594.108669:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789265594.109621:0:9780:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789265594.109626:0:9780:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1789265594.109647:0:9780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789265594.111348:0:15357:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3641 00000020:00000080:0.0:1789265594.111366:0:15357:0:(genops.c:885:class_export_put()) final put ffff93775f50b000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789265594.111881:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93775f50b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789265594.115378:0:15357:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3656 00000020:00000080:0.0:1789265594.115398:0:15357:0:(genops.c:885:class_export_put()) final put ffff9377442c4000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789265594.115457:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1789265594.115464:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265594.115476:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789265594.115482:0:15357:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff93775f544d28) has no exports 00000004:01000000:0.0:1789265594.115750:0:15357:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789265594.115760:0:15357:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d395f 00000020:00000080:0.0:1789265594.115766:0:15357:0:(genops.c:885:class_export_put()) final put ffff937642788000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789265594.119896:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9377442c4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1789265594.122042:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff937642788000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789265594.122935:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789265594.124959:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265594.124986:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789265594.124993:0:15357:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9376433a8000) has no exports 00000020:00000080:2.0:1789265594.125007:0:15357:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3958 00000020:00000080:2.0:1789265594.125018:0:15357:0:(genops.c:885:class_export_put()) final put ffff9376420e1800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789265594.125139:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9376420e1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789265594.131942:0:15357:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789265594.131955:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789265594.131961:0:15357:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1789265594.131975:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265594.131978:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789265594.132919:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265594.132944:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789265594.132958:0:15357:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d381d 00000020:00000080:2.0:1789265594.132972:0:15357:0:(genops.c:885:class_export_put()) final put ffff9376424d4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265594.134664:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9376420e7800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789265594.134683:0:38:0:(genops.c:885:class_export_put()) final put ffff9376424d7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265594.134687:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9376424d7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789265594.134706:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789265594.135394:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789265594.135404:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265594.135419:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789265594.135426:0:15357:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9377778c19b8) has no exports 00000020:00000080:2.0:1789265594.135436:0:15357:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3816 00000020:00000080:2.0:1789265594.135445:0:15357:0:(genops.c:885:class_export_put()) final put ffff93764213f800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789265594.135616:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9376424d4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789265594.135632:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93764213f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789265594.136194:0:15357:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789265594.136201:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789265594.136206:0:15357:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1789265594.136214:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265594.136217:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789265594.136269:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265594.136279:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789265594.136300:0:15357:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789265594.136308:0:15357:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3679 00000020:00000080:2.0:1789265594.136315:0:15357:0:(genops.c:885:class_export_put()) final put ffff93777aaed800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789265594.136321:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789265594.136340:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265594.136345:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789265594.136348:0:15357:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff93777a983370) has no exports 00000020:00000080:2.0:1789265594.136354:0:15357:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3672 00000020:00000080:2.0:1789265594.136358:0:15357:0:(genops.c:885:class_export_put()) final put ffff9377778ba000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789265594.136926:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93764213c800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789265594.136937:0:38:0:(genops.c:885:class_export_put()) final put ffff93764213d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789265594.136940:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93764213d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789265594.136946:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789265594.137042:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93777aaed800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789265594.137047:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9377778ba000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789265594.194035:0:15357:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789265594.194048:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265594.194053:0:15357:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789265594.194066:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789265594.194190:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265594.194208:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789265594.194261:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265594.194264:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789265594.194271:0:15357:0:(genops.c:885:class_export_put()) final put ffff937752855000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265594.194277:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff937752855000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789265594.194288:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789265594.194429:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9377778bf800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789265594.194439:0:38:0:(genops.c:885:class_export_put()) final put ffff9377778b9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789265594.194441:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9377778b9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789265594.194454:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789265594.194847:0:15357:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d365d 00000020:00000080:0.0:1789265594.194899:0:15357:0:(genops.c:885:class_export_put()) final put ffff9377442c5800/lustre-MDD0001_UUID 00000020:01000000:0.0:1789265594.194911:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789265594.194931:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265594.194937:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789265594.194942:0:15357:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9377778c3370) has no exports 00000020:00000080:0.0:1789265594.194980:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265594.194991:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789265594.194997:0:15357:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3664 00000020:00000080:0.0:1789265594.195003:0:15357:0:(genops.c:885:class_export_put()) final put ffff9377442c4800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789265594.195025:0:15357:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93774e5c3000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789265594.195028:0:15357:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93774e5c3000 2 00000020:01000004:0.0:1789265594.195032:0:15357:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93774e5c3000 from lustre-MDT0001 00000020:00000080:0.0:1789265594.195055:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265594.195059:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789265594.195062:0:15357:0:(genops.c:885:class_export_put()) final put ffff93775f50c800/lustre-MDT0001_UUID 00000020:00000080:0.0:1789265594.195064:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff93775f50c800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789265594.195072:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789265594.195110:0:15357:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789265594.195114:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789265594.195117:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265594.195120:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789265594.195129:0:15357:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9377778bc800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789265594.195134:0:15357:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff93775f68b370) has exports, disconnecting them 00000020:00080000:0.0:1789265594.195139:0:15357:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9377778bc800), last request at 1789265334 00000020:00000080:0.0:1789265594.195143:0:15357:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d36b8 00000020:00080000:0.0:1789265594.195155:0:15357:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9377778bc800): rc 0 00000020:00000080:0.0:1789265594.195159:0:15357:0:(genops.c:885:class_export_put()) final put ffff9377778bc800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789265594.196192:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9377442c5800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789265594.196203:0:38:0:(genops.c:885:class_export_put()) final put ffff9377582c7800/lustre-MDD0001_UUID 00000020:00000080:1.0:1789265594.196205:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9377582c7800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789265594.196212:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789265594.196459:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9377442c4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789265594.196465:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9377778bc800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789265594.245013:0:15357:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789265594.245027:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265594.245034:0:15357:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789265594.245046:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789265594.245092:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937752850000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789265594.245563:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265594.245576:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789265594.245584:0:15357:0:(genops.c:885:class_export_put()) final put ffff93777aaec800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789265594.245606:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff93777aaec800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789265594.245614:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789265594.245713:0:15357:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93774e5c3000 1 00000020:00000080:1.0:1789265594.245721:0:15357:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d35f4 00000020:00000080:1.0:1789265594.245729:0:15357:0:(genops.c:885:class_export_put()) final put ffff93777786d800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789265594.245744:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789265594.245754:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93777786d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789265594.245764:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265594.245770:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789265594.245776:0:15357:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff93775f688000) has no exports 00000100:00080000:1.0:1789265594.368236:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 50e161d8-da73-42e3-8b96-d311cd2235de->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265594.368255:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 50e161d8-da73-42e3-8b96-d311cd2235de->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265594.368259:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265594.368264:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789265594.368270:0:38:0:(import.c:65:import_set_state_nolock()) ffff9376420e2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265594.368283:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 444 00000100:00080000:1.0:1789265594.368292:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789265594.368303:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9376420e2800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1789265594.368375:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f158000 x1876180579038976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265594.368446:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265594.368450:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789265594.368452:0:38:0:(import.c:65:import_set_state_nolock()) ffff9376420e7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265594.368455:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 444 00000100:00080000:1.0:1789265594.368458:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789265594.368463:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9376420e7000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1789265594.368496:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f15ad80 x1876180579039232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265594.368587:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180579039104:0@lo:400:kworker.0 00000100:00100000:1.0:1789265594.368676:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265594.368754:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265594.368761:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180579039360:0@lo:400:kworker.0 00000100:00100000:1.0:1789265594.368797:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265594.378986:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579039104 00000100:00100000:0.0:1789265594.379014:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579039104 00000100:00100000:0.0:1789265594.379093:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579039360 00000100:00100000:0.0:1789265594.379098:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579039360 00000100:00100000:0.0:1789265594.379148:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789265594.379159:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1876180579039104:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789265594.379170:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789265594.379299:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1876180579039104:12345-0@lo:400:kworker.0 Request processed in 140us (10621us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265594.379307:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789265594.379330:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789265594.379335:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876180579039360:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789265594.379340:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789265594.379384:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876180579039360:12345-0@lo:400:kworker.0 Request processed in 47us (10585us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265594.379390:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:0.0:1789265594.379450:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265594.379456:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9376424d0000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789265594.379461:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789265594.384055:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789265594.384066:0:3646:0:(import.c:65:import_set_state_nolock()) ffff937641a6d000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789265594.384071:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789265594.384087:0:3646:0:(import.c:65:import_set_state_nolock()) ffff937641a6d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265594.384092:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 215 00000100:00080000:1.0:1789265594.384101:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff937641a6d000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1789265594.384139:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f15b800 x1876180579039488/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265594.384160:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180579039104:0@lo:400:kworker.0 00000100:00080000:0.0:1789265594.395323:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9376424d0000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265594.395342:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 240 00000100:00080000:0.0:1789265594.395357:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9376424d0000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265594.395412:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37e680 x1876180579039616/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265594.395437:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876180579039360:0@lo:400:kworker.0 00000100:00100000:1.0:1789265594.449134:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180579038976:0@lo:38:kworker.0 00000100:00100000:1.0:1789265594.449247:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265594.449334:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180579039232:0@lo:38:kworker.0 00000100:00100000:1.0:1789265594.449360:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265594.449386:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180579039488:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789265594.449409:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265594.449670:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180579039616:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789265594.449714:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265594.449769:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579038976 00000100:00100000:1.0:1789265594.449779:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579038976 00000100:00100000:1.0:1789265594.450382:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579039232 00000100:00100000:1.0:1789265594.450388:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579039232 00000100:00100000:1.0:1789265594.450399:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579039488 00000100:00100000:1.0:1789265594.450402:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579039488 00000100:00100000:1.0:1789265594.450410:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579039616 00000100:00100000:1.0:1789265594.450412:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579039616 00000100:00100000:1.0:1789265594.450788:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789265594.451146:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876180579038976:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789265594.451174:0:6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265594.481998:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789265594.482018:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180579039232:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789265594.482051:0:6520:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265594.482396:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180579039232:12345-0@lo:38:kworker.0 Request processed in 378us (33031us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265594.482406:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789265594.482441:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789265594.482448:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180579039488:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1789265594.482460:0:6520:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265594.482491:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180579039488:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 43us (33081us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265594.482498:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789265594.482511:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789265594.482516:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180579039616:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1789265594.482623:0:6520:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265594.482654:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180579039616:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 136us (32940us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265594.482661:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00080000:1.0:1789265594.483727:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376420e7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265594.483738:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789265594.483746:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180579039232:0@lo:38:kworker.0 00000100:00080000:1.0:1789265594.483764:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937641a6d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265594.483840:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789265594.483846:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180579039488:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1789265594.483889:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376424d0000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265594.483894:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789265594.483897:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180579039616:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789265594.484073:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876180579038976:12345-0@lo:38:kworker.0 Request processed in 32929us (34826us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265594.484083:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:1.0:1789265594.484972:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376420e2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265594.484979:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789265594.484983:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180579038976:0@lo:38:kworker.0 00000020:00000080:2.0:1789265594.530979:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265594.531001:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789265594.531010:0:15357:0:(genops.c:885:class_export_put()) final put ffff93774e5c6000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789265594.531016:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff93774e5c6000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789265594.531028:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789265594.531182:0:15357:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93774e5c4000 00000020:01000000:2.0:1789265594.531208:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789265594.531213:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265594.531219:0:15357:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789265594.531225:0:15357:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff93775f540000) has no exports 00000100:00100000:1.0:1789265594.531373:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff937779d65000:6520] 1 exiting: rc = 0 00000100:00100000:1.0:1789265594.531524:0:14174:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9376420df000:14174] 4 exiting: rc = 0 00000100:00100000:1.0:1789265594.531646:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff937779d65400:6521] 2 exiting: rc = 0 00000100:00100000:0.0:1789265594.531800:0:9988:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9376425d9200:9988] 3 exiting: rc = 0 00000100:00100000:3.0:1789265594.532727:0:6519:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff93775dc23e00:6519] 0 exiting: rc = 1 00000100:00100000:2.0:1789265594.532830:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532854:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532885:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532892:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532898:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532905:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532912:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532918:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532924:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532929:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532936:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532942:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532948:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532953:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532959:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532965:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532980:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.532994:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533002:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533039:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533044:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533051:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533065:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533073:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533079:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533087:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533092:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533099:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533105:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533111:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533116:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533123:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533145:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533163:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533178:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533185:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533191:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533196:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533202:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533208:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533214:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533220:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533227:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533234:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533241:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533247:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533254:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533261:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533267:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533273:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533280:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533285:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533291:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533297:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533312:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533318:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533324:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533331:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533337:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533343:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533349:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533356:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533362:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.533376:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.538275:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93775f66e800:6523] 1 exiting: rc = 0 00000100:00100000:0.0:1789265594.538803:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93775f419800:6522] 0 exiting: rc = 1 00000100:00100000:0.0:1789265594.547446:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547464:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547482:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547513:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547520:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547527:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547547:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547554:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547561:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547567:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547573:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547580:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547589:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547595:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547601:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547607:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547612:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547618:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547624:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547630:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547635:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547641:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547648:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547654:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547660:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547666:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547673:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547678:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547683:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547689:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547695:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547701:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547707:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547712:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547718:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547723:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547728:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547734:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547747:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547753:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547759:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547765:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547771:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547776:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547782:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547787:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547792:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547798:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547804:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547809:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547815:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547821:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547827:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547832:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547839:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547844:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547849:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547855:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547881:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547887:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547892:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547898:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547904:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.547911:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.548511:0:10357:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff93777ab6aa00:10357] 2 exiting: rc = 0 00000100:00100000:1.0:1789265594.548834:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff93775f64e000:6525] 1 exiting: rc = 0 00000100:00100000:2.0:1789265594.559038:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff93775f64ee00:6524] 0 exiting: rc = 1 00000100:00100000:0.0:1789265594.560420:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560452:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560462:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560469:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560476:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560482:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560488:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560496:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560565:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560573:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560579:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560587:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560594:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560600:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560608:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560618:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560626:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560635:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560641:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560648:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560671:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560679:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560686:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560693:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560700:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560706:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560712:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560719:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560727:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560734:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560740:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560748:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560782:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560791:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560799:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560806:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560814:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560820:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560826:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560832:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560839:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560845:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560851:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560886:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560911:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560920:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560927:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560934:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560944:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560951:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560958:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560966:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560973:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560980:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560987:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.560995:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.561030:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.561038:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.561045:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.561054:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.561062:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.561068:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.561075:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.561082:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.625010:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93775f88a200:6526] 0 exiting: rc = 1 00000100:00100000:2.0:1789265594.628800:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93775f88b000:6527] 1 exiting: rc = 0 00000100:00100000:1.0:1789265594.635547:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635594:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635601:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635608:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635614:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635620:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635625:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635634:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635640:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635646:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635653:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635659:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635664:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635669:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635674:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635680:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635686:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635691:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635696:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635701:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635707:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635713:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635718:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635725:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635731:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635736:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635743:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635748:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635753:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635758:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635764:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635769:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635774:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635780:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635786:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635792:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635807:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635813:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635819:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635824:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635829:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635835:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635841:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635846:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635881:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635891:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635898:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635904:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635909:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635915:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635921:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635927:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635932:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635938:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635944:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635950:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635956:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635961:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635968:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635974:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635980:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635986:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635991:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.635997:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265594.637176:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93775f88b800:6528] 0 exiting: rc = 1 00000100:00100000:0.0:1789265594.637457:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93775f88bc00:6529] 1 exiting: rc = 0 00000100:00100000:3.0:1789265594.637604:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637613:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637620:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637626:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637632:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637649:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637654:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637660:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637666:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637671:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637677:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637682:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637689:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637694:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637700:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637706:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637712:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637718:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637723:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637729:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637734:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637741:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637746:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637752:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637782:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637789:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637794:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637800:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637807:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637813:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637819:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637824:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637829:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637836:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637843:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637849:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637854:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637893:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637900:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637906:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637920:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637926:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637932:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637937:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637943:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637948:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637954:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637959:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637964:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637971:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637977:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637983:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637988:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.637994:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.638001:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.638006:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.638012:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.638018:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.638024:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.638029:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.638034:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.638039:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.638045:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.638050:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.645715:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff93775f88b600:6530] 0 exiting: rc = 1 00000100:00100000:2.0:1789265594.645907:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff93775f88ba00:6531] 1 exiting: rc = 0 00000100:00100000:0.0:1789265594.651016:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651028:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651034:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651039:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651044:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651049:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651055:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651060:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651066:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651071:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651077:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651082:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651087:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651116:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651122:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651127:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651132:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651138:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651143:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651149:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651154:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651159:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651165:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651170:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651176:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651181:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651186:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651191:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651197:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651203:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651208:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651213:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651218:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651223:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651229:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651234:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651239:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651245:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651251:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651257:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651262:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651268:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651273:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651278:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651284:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651289:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651295:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651301:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651314:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651319:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651325:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651331:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651337:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651343:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651349:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651355:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651360:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651365:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651370:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651376:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651381:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651386:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651392:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265594.651398:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265594.652356:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff93775f66e600:6533] 1 exiting: rc = 0 00000100:00100000:3.0:1789265594.652691:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff93775f416600:6532] 0 exiting: rc = 1 00000100:00100000:1.0:1789265594.653873:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff937743571400:6534] 2 exiting: rc = 0 00000100:00100000:3.0:1789265594.657397:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657414:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657421:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657428:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657434:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657440:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657447:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657453:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657461:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657477:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657508:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657514:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657520:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657526:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657533:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657548:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657555:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657580:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657587:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657593:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657600:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657606:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657612:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657618:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657624:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657630:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657636:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657642:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657648:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657655:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657662:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657668:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657676:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657682:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657689:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657694:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657701:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657707:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657713:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657721:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657728:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657750:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657757:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657763:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657769:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657782:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657787:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657793:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657798:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657805:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657811:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657817:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657823:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657828:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657834:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657840:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657846:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657851:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657886:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657894:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657900:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657906:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657912:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265594.657926:0:15357:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789265594.669843:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265594.670693:0:15357:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789265594.670703:0:15357:0:(genops.c:885:class_export_put()) final put ffff93775f50e000/MDS_uuid 00000020:00000080:3.0:1789265594.670710:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff93775f50e000/MDS_uuid for MDS 00000020:01000000:3.0:1789265594.670718:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789265594.671000:0:15357:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789265594.932079:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265595.957223:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265596.982959:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265598.003480:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789265598.400660:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 50e161d8-da73-42e3-8b96-d311cd2235de->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789265598.400672:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 50e161d8-da73-42e3-8b96-d311cd2235de->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265598.400676:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789265598.400681:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789265598.400686:0:37:0:(import.c:65:import_set_state_nolock()) ffff9376420e2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265598.400695:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 450 00000100:00080000:3.0:1789265598.400713:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789265598.400721:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9376420e2800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265598.400829:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9376434d7b80 x1876180579039744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265598.400977:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180579039744:0@lo:38:kworker.0 00000400:00000100:1.0:1789265598.401046:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180579039744 offset 0 length 520: 4 00000100:00080000:3.0:1789265598.402467:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789265598.402479:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789265598.402483:0:37:0:(import.c:65:import_set_state_nolock()) ffff937641a6d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265598.402492:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 450 00000100:00080000:3.0:1789265598.402512:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789265598.402520:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff937641a6d000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265598.402853:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9376434d7100 x1876180579039872/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265598.411976:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180579039872:0@lo:38:kworker.0 00000400:00000100:1.0:1789265598.412066:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180579039872 offset 0 length 520: 4 00000100:00080000:3.0:1789265598.414247:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789265598.414260:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789265598.414265:0:37:0:(import.c:65:import_set_state_nolock()) ffff9376420e7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265598.414275:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 450 00000100:00080000:3.0:1789265598.414282:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789265598.414290:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9376420e7000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265598.414338:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9376434d5880 x1876180579040000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265598.414356:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789265598.414360:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789265598.414362:0:37:0:(import.c:65:import_set_state_nolock()) ffff9376424d0000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265598.414366:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 450 00000100:00080000:3.0:1789265598.414377:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789265598.414381:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9376424d0000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265598.414395:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9376434d4700 x1876180579040128/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265598.414474:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180579040000:0@lo:38:kworker.0 00000400:00000100:1.0:1789265598.414549:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180579040000 offset 0 length 520: 4 00000100:00100000:1.0:1789265598.414610:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180579040128:0@lo:38:kworker.0 00000400:00000100:1.0:1789265598.414631:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180579040128 offset 0 length 520: 4 00010000:00010000:0.0:1789265599.028287:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789265599.257147:0:15558:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789265599.271621:0:15558:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789265599.271708:0:15558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a38 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265599.271737:0:15558:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a38 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265599.271746:0:15558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a38 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265599.271754:0:15558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a38 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265599.271784:0:15558:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789265599.271790:0:15558:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789265599.271848:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265599.271896:0:15558:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9376434d7b80 x1876180579039744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265618 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789265599.271900:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265599.271909:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a38 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265599.271918:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc600 already unused, calling callback (ffffffffc13cbc20) 00000100:00100000:0.0:1789265599.271918:0:15558:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 10000000:00010000:1.0:1789265599.271922:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a38 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789265599.271926:0:15558:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1789265599.271932:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3a38 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789265599.271935:0:15558:0:(import.c:65:import_set_state_nolock()) ffff9376420e2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 10000000:00010000:1.0:1789265599.271940:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3a38 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789265599.271940:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265599.271944:0:15558:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9376434d7b80 x1876180579039744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265618 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789265599.271947:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265599.271949:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:0.0:1789265599.271952:0:15558:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 10000000:01000000:1.0:1789265599.271953:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1789265599.271955:0:15558:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:1.0:1789265599.271971:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937779e27000 00010000:00010000:1.0:1789265599.271977:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xbbfdc9019c1d3a38 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265599.271984:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9376435fc600/0xbbfdc9019c1d3a31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xbbfdc9019c1d3a38 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265599.272011:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265599.272013:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265599.272014:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265599.272115:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180579039744:0@lo:38:kworker.0 00000100:00080000:0.0:1789265599.273467:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789265599.273484:0:15558:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9376434d7100 x1876180579039872/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265613 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265599.273523:0:15558:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789265599.273530:0:15558:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789265599.273536:0:15558:0:(import.c:65:import_set_state_nolock()) ffff937641a6d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789265599.273542:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789265599.273546:0:15558:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9376434d7100 x1876180579039872/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265613 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265599.273552:0:15558:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789265599.273556:0:15558:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:2.0:1789265599.273576:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180579039872:0@lo:38:kworker.0 00010000:00010000:0.0:1789265599.274572:0:15558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a46 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265599.274591:0:15558:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a46 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265599.274624:0:15558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a46 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265599.274631:0:15558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a46 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265599.274660:0:15558:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265599.274669:0:15558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cc3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265599.274677:0:15558:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3cc3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265599.274683:0:15558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3cc3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265599.274689:0:15558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3cc3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265599.274707:0:15558:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789265599.274711:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:0.0:1789265599.274712:0:15558:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1789265599.274720:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a46 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265599.274727:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643218800 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265599.274731:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a46 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265599.274740:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3a46 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789265599.274743:0:15558:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789265599.274748:0:15558:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789265599.274753:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:2.0:1789265599.274757:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3a46 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789265599.274759:0:15558:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 10000000:01000000:2.0:1789265599.274763:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789265599.274765:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00000020:00080000:0.0:1789265599.274766:0:15558:0:(genops.c:1819:print_export_data()) lustre-OST0000: UNLINKED ffff9376420e3000 lustre-MDT0001-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 4294967297 stale:0 10000000:01000000:2.0:1789265599.274768:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:00080000:0.0:1789265599.274772:0:15558:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9377778c4d28) has no exports 00010000:00010000:2.0:1789265599.274784:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937779e27000 00010000:00010000:2.0:1789265599.274788:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbbfdc9019c1d3a46 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265599.274794:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937643218800/0xbbfdc9019c1d3a3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbbfdc9019c1d3a46 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789265599.274799:0:15558:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9377778c4d28) has no exports 00010000:00010000:2.0:1789265599.274810:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265599.274813:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3cc3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265599.274819:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937643219c00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265599.274822:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3cc3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265599.274829:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3cc3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265599.274835:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3cc3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265599.274839:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789265599.274841:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789265599.274847:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789265599.274853:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937779e27000 00010000:00010000:2.0:1789265599.274856:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbbfdc9019c1d3cc3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265599.274890:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937643219c00/0xbbfdc9019c1d3cbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbbfdc9019c1d3cc3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265599.274899:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265599.274901:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265599.274903:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265599.275598:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789265599.482853:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789265599.482881:0:9512:0:(genops.c:885:class_export_put()) final put ffff93764278a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789265599.483991:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93764278a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789265599.484080:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937642788800 for lustre-OST0001 00000001:00100000:2.0:1789265599.484227:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789265599.484233:0:8429:0:(genops.c:885:class_export_put()) final put ffff9376420e3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265599.484312:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9376420e3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789265599.484712:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9376420e4000 for lustre-OST0000 00010000:00010000:1.0:1789265600.051659:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265601.075183:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789265601.331208:0:15558:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff937748476f60 - data ffff9377736dc1b0/ffff937643346c00 00000020:01000000:0.0:1789265601.331999:0:15558:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93764220c2a0 - data ffff9377735a9a20/ffff93777f383c00 00100000:10000000:0.0:1789265601.366295:0:15558:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789265601.375913:0:15558:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3791 00000020:00000080:2.0:1789265601.375932:0:15558:0:(genops.c:885:class_export_put()) final put ffff93777786e000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789265601.375957:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93777786e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1789265601.375973:0:15558:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93777aaec000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789265601.375977:0:15558:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93777aaec000 2 00000020:01000004:2.0:1789265601.375981:0:15558:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93777aaec000 from lustre-OST0000 00000020:00000080:2.0:1789265601.376037:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265601.376050:0:15558:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789265601.376054:0:15558:0:(genops.c:885:class_export_put()) final put ffff93774f174800/lustre-OST0000_UUID 00000020:00000080:2.0:1789265601.376057:0:15558:0:(genops.c:844:class_export_destroy()) destroying export ffff93774f174800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789265601.376065:0:15558:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789265601.377960:0:15558:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789265601.377975:0:15558:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789265601.377992:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265601.378005:0:15558:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789265601.378041:0:15558:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9376420e0000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789265601.378051:0:15558:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff93774f18b370) has exports, disconnecting them 00000020:00080000:2.0:1789265601.378059:0:15558:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9376420e0000), last request at 1789265359 00000020:00000080:2.0:1789265601.378066:0:15558:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d37bb 00000020:00080000:2.0:1789265601.395737:0:15558:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9376420e0000): rc 0 00000020:00000080:2.0:1789265601.395753:0:15558:0:(genops.c:885:class_export_put()) final put ffff9376420e0000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789265601.395841:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9376420e0000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789265601.400942:0:15558:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789265601.400955:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789265601.400961:0:15558:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789265601.400982:0:15558:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789265601.402071:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265601.402088:0:15558:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789265601.402110:0:15558:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789265601.402118:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265601.402124:0:15558:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789265601.402142:0:15558:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff937641a6b800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789265601.402150:0:15558:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff93777a980000) has exports, disconnecting them 00000020:00080000:3.0:1789265601.402156:0:15558:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff937641a6b800), last request at 1789265359 00000020:00000080:3.0:1789265601.402161:0:15558:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d37d0 00000020:00080000:3.0:1789265601.402186:0:15558:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff937641a6b800): rc 0 00000020:00000080:3.0:1789265601.402360:0:15558:0:(genops.c:885:class_export_put()) final put ffff937641a6b800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789265601.403763:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9376420e2800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789265601.403781:0:38:0:(genops.c:885:class_export_put()) final put ffff9376420e4800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789265601.403785:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9376420e4800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789265601.403803:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789265601.403905:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff937641a6b800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1789265601.544963:0:15558:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789265601.544978:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789265601.544985:0:15558:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789265601.545007:0:15558:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789265601.545056:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937641a6d000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789265601.545455:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265601.545482:0:15558:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1789265601.545489:0:15558:0:(genops.c:885:class_export_put()) final put ffff937641a6a000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1789265601.545494:0:15558:0:(genops.c:844:class_export_destroy()) destroying export ffff937641a6a000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789265601.545510:0:15558:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1789265601.545620:0:15558:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93777aaec000 1 00000020:00000080:1.0:1789265601.545630:0:15558:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3759 00000020:00000080:1.0:1789265601.545640:0:15558:0:(genops.c:885:class_export_put()) final put ffff9377778be800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789265601.545655:0:15558:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789265601.545668:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9377778be800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789265601.545766:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265601.545777:0:15558:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789265601.545787:0:15558:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff93777a984d28) has no exports 00000020:00000080:0.0:1789265601.650497:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265601.650515:0:15558:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789265601.650522:0:15558:0:(genops.c:885:class_export_put()) final put ffff93777aaea000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789265601.650528:0:15558:0:(genops.c:844:class_export_destroy()) destroying export ffff93777aaea000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789265601.650541:0:15558:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789265601.650735:0:15558:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93777aaef800 00000020:02000400:0.0:1789265601.650789:0:15558:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789265602.100111:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265603.123954:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265603.507414:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265593/real 1789265593] req@ffff93774f37ed80 x1876180579038848/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789265603 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265603.507447:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93774f37ed80 x1876180579038848/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789265603 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789265603.507491:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937779e27000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789265603.507517:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789265603.507522:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:50e161d8-da73-42e3-8b96-d311cd2235de:3642:1876180579038848:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1789265603.507806:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 50e161d8-da73-42e3-8b96-d311cd2235de->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789265603.507821:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789265603.507825:0:37:0:(import.c:65:import_set_state_nolock()) ffff937779e27000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265603.507830:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.142@tcp: connect to NID 0@lo last attempt 449 00000100:00080000:0.0:1789265603.507835:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.142@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789265603.507842:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.142@tcp: import ffff937779e27000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265603.507895:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37dc00 x1876180579040256/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265603.507919:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789265603.507923:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265603.507926:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789265603.507929:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789265603.507962:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:50e161d8-da73-42e3-8b96-d311cd2235de:3642:1876180579040256:0@lo:250:kworker.0 00000400:00000100:3.0:1789265603.508008:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180579040256 offset 0 length 520: 4 00010000:00010000:2.0:1789265604.147479:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265605.171191:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789265605.873714:0:15759:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789265605.902002:0:15759:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789265605.902094:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a1c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265605.902110:0:15759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a1c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265605.902118:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a1c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265605.902125:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a1c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265605.902146:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789265605.902151:0:15759:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789265605.902175:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265605.902187:0:15759:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9376434d5880 x1876180579040000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265618 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265605.902213:0:15759:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789265605.902219:0:15759:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789265605.902238:0:15759:0:(import.c:65:import_set_state_nolock()) ffff9376420e7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789265605.902243:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265605.902248:0:15759:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9376434d5880 x1876180579040000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265618 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265605.902255:0:15759:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789265605.902259:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:1.0:1789265605.902358:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265605.902365:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a1c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265605.902373:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc800 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265605.902377:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a1c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265605.902385:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3a1c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265605.902392:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3a1c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265605.902397:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265605.902399:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789265605.902401:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789265605.902417:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937779e27000 00010000:00010000:1.0:1789265605.902421:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbbfdc9019c1d3a1c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265605.902427:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9376435fc800/0xbbfdc9019c1d3a15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbbfdc9019c1d3a1c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265605.902448:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265605.902451:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265605.902452:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265605.904520:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180579040000:0@lo:38:kworker.0 00000100:00080000:3.0:1789265605.908349:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789265605.908367:0:15759:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9376434d4700 x1876180579040128/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265613 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265605.908385:0:15759:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789265605.908390:0:15759:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789265605.908397:0:15759:0:(import.c:65:import_set_state_nolock()) ffff9376424d0000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789265605.908403:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789265605.908406:0:15759:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9376434d4700 x1876180579040128/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265613 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265605.908413:0:15759:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789265605.908416:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:0.0:1789265605.908702:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180579040128:0@lo:38:kworker.0 00010000:00010000:3.0:1789265605.909908:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3a2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265605.909924:0:15759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3a2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265605.909931:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265605.909952:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3a2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265605.910440:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265605.910452:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d3cae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265605.910460:0:15759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d3cae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265605.910467:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3cae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265605.910473:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbbfdc9019c1d3cae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265605.915527:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265605.915545:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265605.915558:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393600 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265605.915563:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3a2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265605.915574:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3a2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265605.915582:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3a2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265605.915587:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789265605.915590:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789265605.915607:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937779e27000 00010000:00010000:2.0:1789265605.915611:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbbfdc9019c1d3a2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265605.915619:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d3a23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbbfdc9019c1d3a2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265605.915640:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265605.915663:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3cae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265605.915669:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392000 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265605.915672:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbbfdc9019c1d3cae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265605.915679:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3cae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265605.915685:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3cae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265605.915690:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789265605.915692:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789265605.915697:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937779e27000 00010000:00010000:2.0:1789265605.915699:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbbfdc9019c1d3cae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265605.915706:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265605.915707:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265605.915709:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265605.918514:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789265605.918531:0:15759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937642392000/0xbbfdc9019c1d3ca7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbbfdc9019c1d3cae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265605.918556:0:15759:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1789265605.918564:0:15759:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1789265605.918566:0:15759:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789265605.918607:0:15759:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789265605.918613:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789265605.918620:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265605.918627:0:15759:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789265605.918632:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff93774f18cd28) has no exports 00000020:00080000:3.0:1789265605.918661:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff93774f18cd28) has no exports 00000020:01000000:3.0:1789265605.924516:0:15759:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9377811aa300 - data ffff9377736ec438/ffff93774f0e5400 00000020:01000000:3.0:1789265605.924718:0:15759:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93764322a9c0 - data ffff9377735a0e58/ffff937643360000 00010000:00010000:0.0:1789265605.929606:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789265605.951163:0:15759:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789265605.965971:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d38b7 00000020:00000080:0.0:1789265605.965992:0:15759:0:(genops.c:885:class_export_put()) final put ffff937642789000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789265605.966017:0:15759:0:(tgt_mount.c:187:server_put_mount()) put mount ffff937641a6a800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789265605.966021:0:15759:0:(obd_mount.c:710:lustre_put_lsi()) put ffff937641a6a800 2 00000020:01000004:0.0:1789265605.966024:0:15759:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff937641a6a800 from lustre-OST0001 00000020:00000080:0.0:1789265605.966067:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265605.966078:0:15759:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789265605.966082:0:15759:0:(genops.c:885:class_export_put()) final put ffff93764278b800/lustre-OST0001_UUID 00000020:00000080:0.0:1789265605.966085:0:15759:0:(genops.c:844:class_export_destroy()) destroying export ffff93764278b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789265605.966092:0:15759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789265605.966254:0:15759:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 50e161d8-da73-42e3-8b96-d311cd2235de->MGS 00010000:00010000:0.0:1789265605.966270:0:15759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bdc00/0xbbfdc9019c1d3610 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3617 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265605.966284:0:15759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bdc00/0xbbfdc9019c1d3610 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3617 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265605.966290:0:15759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789265605.966293:0:15759:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789265605.966297:0:15759:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789265605.966311:0:15759:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937779e27000 00010000:00010000:0.0:1789265605.966314:0:15759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bdc00/0xbbfdc9019c1d3610 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbbfdc9019c1d3617 expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265605.966328:0:15759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937643218c00/0xbbfdc9019c1d3a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbbfdc9019c1d3a8c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265605.966335:0:15759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937643218c00/0xbbfdc9019c1d3a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbbfdc9019c1d3a8c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265605.966355:0:15759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789265605.966358:0:15759:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789265605.966360:0:15759:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789265605.966370:0:15759:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff937779e27000 00010000:00010000:0.0:1789265605.966373:0:15759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937643218c00/0xbbfdc9019c1d3a85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbbfdc9019c1d3a8c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789265605.966391:0:15759:0:(import.c:65:import_set_state_nolock()) ffff937779e27000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789265605.966395:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789265605.966397:0:15759:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789265605.966399:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789265605.966403:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789265605.966415:0:15759:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93774f37dc00 x1876180579040256/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789265618 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789265605.966443:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789265605.966447:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:0.0:1789265605.966480:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:50e161d8-da73-42e3-8b96-d311cd2235de:3642:1876180579040256:0@lo:250:kworker.0 10000000:01000000:0.0:1789265605.966508:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789265605.966515:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d350d 00000020:00000080:0.0:1789265605.966520:0:15759:0:(genops.c:885:class_export_put()) final put ffff93775f509000/50e161d8-da73-42e3-8b96-d311cd2235de 00000020:01000000:0.0:1789265605.966525:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.142@tcp (flags='') 00000020:00000080:0.0:1789265605.966529:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265605.966534:0:15759:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.142@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789265605.966537:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff93775f68cd28) has no exports 00000020:00000080:3.0:1789265605.973847:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff937642789000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789265605.973894:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93775f509000/50e161d8-da73-42e3-8b96-d311cd2235de for MGC192.168.202.142@tcp 10000000:01000000:3.0:1789265605.973919:0:6516:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789265605.974161:0:15759:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.142@tcp: client import never connected 00000100:00080000:0.0:1789265605.974167:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789265605.974171:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789265605.974174:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789265605.974177:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789265605.974238:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265605.974273:0:15759:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.142@tcp (uuid 50e161d8-da73-42e3-8b96-d311cd2235de) 00000020:01000000:0.0:1789265605.974284:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789265605.974289:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265605.974295:0:15759:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789265605.974303:0:15759:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93764278a000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789265605.974309:0:15759:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff93774f1899b8) has exports, disconnecting them 00000020:00080000:0.0:1789265605.974314:0:15759:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93764278a000), last request at 1789265384 00000020:00000080:0.0:1789265605.974319:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d38e1 00000020:00080000:0.0:1789265605.974335:0:15759:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93764278a000): rc 0 00000020:00000080:0.0:1789265605.974340:0:15759:0:(genops.c:885:class_export_put()) final put ffff93764278a000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789265605.975262:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937779e27000 for MGC192.168.202.142@tcp 00000020:00000080:3.0:1789265605.975272:0:38:0:(genops.c:885:class_export_put()) final put ffff937779e25000/50e161d8-da73-42e3-8b96-d311cd2235de 00000020:00000080:3.0:1789265605.975276:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff937779e25000/50e161d8-da73-42e3-8b96-d311cd2235de for MGC192.168.202.142@tcp 00000020:01000000:3.0:1789265605.975283:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.142@tcp (50e161d8-da73-42e3-8b96-d311cd2235de) 00000020:00000080:3.0:1789265605.975581:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93764278a000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789265605.981061:0:15759:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789265605.981070:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265605.981074:0:15759:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789265605.981082:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789265605.981319:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265605.981329:0:15759:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1789265605.981336:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789265605.981341:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265605.981345:0:15759:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789265605.981362:0:15759:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9376424d2800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789265605.981368:0:15759:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9376433a99b8) has exports, disconnecting them 00000020:00080000:2.0:1789265605.981373:0:15759:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9376424d2800), last request at 1789265384 00000020:00000080:2.0:1789265605.981377:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d38f6 00000020:00080000:2.0:1789265605.981391:0:15759:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9376424d2800): rc 0 00000020:00000080:2.0:1789265605.981398:0:15759:0:(genops.c:885:class_export_put()) final put ffff9376424d2800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1789265605.982079:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9376420e7000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789265605.982089:0:38:0:(genops.c:885:class_export_put()) final put ffff937642789800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789265605.982092:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff937642789800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789265605.982099:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789265605.982172:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9376424d2800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1789265605.988266:0:15759:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789265605.988279:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789265605.988285:0:15759:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789265605.988294:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789265605.988341:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9376424d0000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1789265605.988698:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1789265605.989937:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1789265605.993331:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789265605.993843:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93774354bc00:6502] 0 exiting: rc = 1 00000100:00100000:0.0:1789265606.003377:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff937742effc00:6503] 1 exiting: rc = 0 00000100:00100000:3.0:1789265606.003681:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.006896:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93775de3e400:6506] 2 exiting: rc = 0 00000100:00100000:0.0:1789265606.013103:0:7460:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff937747dcf200:7460] 3 exiting: rc = 0 00000100:00100000:0.0:1789265606.013245:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93775de3f000:6505] 1 exiting: rc = 0 00000100:00100000:0.0:1789265606.013327:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93775de3ea00:6504] 0 exiting: rc = 1 00000100:00100000:3.0:1789265606.013744:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013755:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013762:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013768:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013774:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013792:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013798:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013805:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013811:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013816:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013822:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013828:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013834:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013839:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013846:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013852:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013894:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013901:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013908:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013914:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013921:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013926:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013931:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013937:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013942:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013947:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013952:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013957:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013962:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013968:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013973:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013978:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013983:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013988:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013993:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.013999:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014005:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014010:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014015:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014020:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014034:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014039:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014044:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014050:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014055:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014060:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014066:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014072:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014077:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014082:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014088:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014093:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014098:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014104:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014109:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014115:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014121:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014126:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014131:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014138:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014143:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014149:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014154:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.014160:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789265606.014981:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265606.014992:0:15759:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1789265606.014999:0:15759:0:(genops.c:885:class_export_put()) final put ffff9376424d4000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1789265606.015004:0:15759:0:(genops.c:844:class_export_destroy()) destroying export ffff9376424d4000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1789265606.015010:0:15759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1789265606.015062:0:15759:0:(obd_mount.c:710:lustre_put_lsi()) put ffff937641a6a800 1 00000020:00000080:3.0:1789265606.015069:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbbfdc9019c1d3886 00000020:00000080:3.0:1789265606.015075:0:15759:0:(genops.c:885:class_export_put()) final put ffff937641a68800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789265606.015087:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789265606.015096:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff937641a68800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789265606.015115:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265606.015121:0:15759:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789265606.015125:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9376426f4d28) has no exports 00000020:00000080:2.0:1789265606.110364:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265606.110378:0:15759:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789265606.110384:0:15759:0:(genops.c:885:class_export_put()) final put ffff937641a68000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789265606.110390:0:15759:0:(genops.c:844:class_export_destroy()) destroying export ffff937641a68000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789265606.110402:0:15759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789265606.110753:0:15759:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff937641a69000 00000020:01000000:2.0:1789265606.110775:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789265606.110779:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265606.110783:0:15759:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789265606.110787:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff93777a9819b8) has no exports 00000020:00000080:2.0:1789265606.110821:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265606.110826:0:15759:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789265606.110829:0:15759:0:(genops.c:885:class_export_put()) final put ffff93777aaeb000/OSS_uuid 00000020:00000080:2.0:1789265606.110831:0:15759:0:(genops.c:844:class_export_destroy()) destroying export ffff93777aaeb000/OSS_uuid for OSS 00000020:01000000:2.0:1789265606.110835:0:15759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1789265606.110959:0:9789:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff937641a03a00:9789] 3 exiting: rc = 0 00000100:00100000:2.0:1789265606.111061:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff93774e57da00:8436] 2 exiting: rc = 0 00000100:00100000:2.0:1789265606.111116:0:14823:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff937643ca5400:14823] 4 exiting: rc = 0 00000100:00100000:2.0:1789265606.111172:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff93777ab67800:8434] 0 exiting: rc = 1 00000100:00100000:2.0:1789265606.111222:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff93774f060e00:8435] 1 exiting: rc = 0 00000100:00080000:1.0:1789265606.114829:0:6515:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789265606.124273:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124295:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124304:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124327:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124335:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124342:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124348:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124354:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124361:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124368:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124373:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124378:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124383:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124391:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124398:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124402:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124408:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124415:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124421:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124427:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124465:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124472:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124477:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124483:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124488:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124495:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124500:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124505:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124510:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124515:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124520:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124526:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124531:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124537:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124541:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124546:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124552:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124557:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124571:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124576:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124582:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124589:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124595:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124600:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124606:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124611:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124623:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124630:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124636:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124642:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124647:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124652:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124658:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124664:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124669:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124674:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124679:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124683:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124688:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124693:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124697:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124702:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124707:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265606.124712:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.128598:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93777aaff000:8437] 0 exiting: rc = 1 00000100:00100000:1.0:1789265606.128709:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93777ab66400:8438] 1 exiting: rc = 0 00000100:00100000:2.0:1789265606.129640:0:13004:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff93774e6f8c00:13004] 2 exiting: rc = 0 00000100:00100000:3.0:1789265606.129849:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129877:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129890:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129895:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129899:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129906:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129911:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129916:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129934:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129940:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129945:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129950:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129955:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129960:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129965:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129971:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129976:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129982:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129987:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129992:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.129997:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130004:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130009:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130014:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130020:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130025:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130030:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130036:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130833:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130839:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130843:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130848:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130894:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130900:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130904:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130909:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130914:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130933:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130940:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130946:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130951:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130956:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130961:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130966:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130971:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130977:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130982:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130987:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130992:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.130998:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.131003:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.131008:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.131014:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.131020:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.131025:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.131031:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.131052:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.131059:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.131064:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.131070:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.131075:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.131080:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.131086:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265606.131091:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.147814:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93774f066600:8441] 2 exiting: rc = 0 00000100:00100000:2.0:1789265606.151652:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93774f067c00:8440] 1 exiting: rc = 0 00000100:00100000:0.0:1789265606.152059:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93774f066a00:8439] 0 exiting: rc = 1 00000100:00100000:1.0:1789265606.165695:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165707:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165714:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165720:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165726:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165742:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165775:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165784:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165790:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165796:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165802:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165809:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165816:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165823:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165829:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165836:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165842:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165849:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165854:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165946:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165952:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165957:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165963:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165968:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165974:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165979:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165984:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165989:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.165994:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166000:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166120:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166128:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166135:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166141:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166147:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166153:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166159:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166166:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166172:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166178:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166184:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166190:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166195:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166201:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166206:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166212:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166219:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166226:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166231:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.166237:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.169530:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.169537:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.169542:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.169547:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.169570:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.169584:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.169610:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.169617:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.169623:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.169628:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.169634:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.169639:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.169645:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.169650:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.181144:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93774f0c8200:8443] 1 exiting: rc = 0 00000100:00100000:3.0:1789265606.181344:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93774f00b200:8442] 0 exiting: rc = 1 00000100:00100000:1.0:1789265606.181582:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181604:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181609:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181615:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181621:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181626:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181631:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181636:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181641:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181646:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181651:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181657:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181663:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181668:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181674:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181680:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181685:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181690:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181695:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181699:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181705:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181710:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181715:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181720:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181725:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181730:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181734:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181739:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181744:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181756:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181762:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181766:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181772:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181777:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181781:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181785:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181796:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181802:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181808:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181813:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181817:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181822:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181827:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181837:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181843:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181848:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181852:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181988:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.181997:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182003:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182008:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182013:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182017:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182028:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182034:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182040:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182044:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182049:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182054:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182058:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182063:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182068:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182072:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.182078:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265606.188380:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9377813d2000:8445] 1 exiting: rc = 0 00000100:00100000:3.0:1789265606.188609:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9377810a9c00:8444] 0 exiting: rc = 1 00000100:00100000:0.0:1789265606.188706:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188715:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188721:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188746:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188754:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188760:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188768:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188774:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188781:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188786:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188793:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188800:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188806:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188812:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188818:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188847:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188856:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188887:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188894:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188900:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188907:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188913:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188920:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188928:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188934:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188940:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188946:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188969:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188978:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188984:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188991:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.188998:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189005:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189013:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189019:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189027:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189049:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189057:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189065:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189096:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189106:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189111:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189118:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189124:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189130:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189136:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189141:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189148:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189153:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189160:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189173:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189195:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189202:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189208:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189214:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189220:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189226:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189232:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189238:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189244:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189250:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189256:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189261:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265606.189276:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789265606.196927:0:15759:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789265630.495763:0:16524:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789265643.083623:0:17123:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789265643.083630:0:17123:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789265643.083632:0:17123:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789265643.083724:0:17123:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93777f58d800 00000020:01000004:2.0:1789265643.083743:0:17123:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789265643.083753:0:17123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789265643.083779:0:17123:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93774f1899b8) 00000020:00000080:2.0:1789265643.083799:0:17123:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789265643.136234:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789265643.137423:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.138460:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789265643.138856:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789265643.139257:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789265643.139451:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789265643.139635:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789265643.140041:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789265643.140275:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789265643.140494:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789265643.140717:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789265643.141027:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789265643.141275:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789265643.141463:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789265643.142675:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789265643.144578:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.144807:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.145153:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.145331:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.145619:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.145799:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.146060:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.146723:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.146912:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.147166:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.147433:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.147607:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.147771:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.148014:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.148212:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.148492:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.148734:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.148944:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.149327:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.149672:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.149880:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.150190:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.150425:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.150651:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.150888:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.151200:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.151482:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.151705:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.151926:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.152214:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789265643.152497:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.152751:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789265643.153916:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789265643.154467:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1789265643.154662:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789265643.155199:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789265643.155502:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789265643.155695:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:2.0:1789265643.156304:0:17123:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789265643.156535:0:17123:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789265643.156545:0:17123:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789265643.156559:0:17123:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d4aca 00000020:01000004:2.0:1789265643.156568:0:17123:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789265643.156574:0:17123:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789265643.156580:0:17123:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93777f58d800 from MGS 00000020:01000004:2.0:1789265643.156584:0:17123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789265643.156597:0:17123:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93774f18cd28) 00000020:00000080:2.0:1789265643.156608:0:17123:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789265643.156680:0:17123:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93777f58d800 from MGS, refs=2 00080000:01000000:2.0:1789265643.156686:0:17123:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789265643.156692:0:17123:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d4ad8 00000100:00100000:2.0:1789265643.156794:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789265643.156986:0:17123:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789265643.156992:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789265643.157829:0:17123:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789265643.157843:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789265643.158723:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265643.159223:0:17123:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789265643.159229:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789265643.159850:0:17123:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789265643.160031:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789265643.160579:0:17123:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789265643.160587:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789265643.163731:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265643.163735:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265643.163736:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265643.164075:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265643.164078:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265643.164160:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265643.164635:0:17123:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:3.0:1789265643.169176:0:17123:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789265643.170058:0:17135:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789265643.170111:0:17123:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789265643.170150:0:17123:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789265643.170893:0:17123:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789265643.171236:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265643.171421:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789265643.171428:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789265643.172203:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789265643.172213:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789265643.172997:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789265643.173004:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00010000:00010000:0.0:1789265643.173811:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265643.175933:0:17139:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1789265643.176058:0:17123:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789265643.176081:0:17123:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.142@tcp' 00000020:01000004:0.0:1789265643.176083:0:17123:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789265643.176122:0:17123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.142@tcp (typ=mgc) 00000020:00000080:0.0:1789265643.176134:0:17123:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.142@tcp (ffff9376433ab370) 00000020:00000080:0.0:1789265643.176150:0:17123:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789265643.176227:0:17123:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93777f399000@MGC192.168.202.142@tcp: add connection 192.168.202.142@tcp at head 00010000:00010000:0.0:1789265643.176503:0:17123:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.142@tcp-0 is initialized 00000040:01000000:0.0:1789265643.176594:0:17123:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789265643.177058:0:17141:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789265643.177145:0:17123:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.142@tcp (uuid c753e2cb-2e3c-4466-8bdc-141f9ba53a83) 00000020:00000080:0.0:1789265643.177161:0:17123:0:(genops.c:1385:class_connect()) connect: client c753e2cb-2e3c-4466-8bdc-141f9ba53a83, cookie 0xbbfdc9019c1d4ae6 00000100:00080000:0.0:1789265643.177171:0:17123:0:(import.c:510:import_select_connection()) MGC192.168.202.142@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265643.177177:0:17123:0:(import.c:624:import_select_connection()) MGC192.168.202.142@tcp: import ffff93777f399000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265643.177208:0:17123:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37dc00 x1876180579040384/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265643.177256:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3642:1876180579040384:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789265643.177461:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265643.177676:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579040384 00000100:00100000:2.0:1789265643.177685:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579040384 00000100:00100000:2.0:1789265643.177730:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265643.177740:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1876180579040384:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789265643.177772:0:17136:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c753e2cb-2e3c-4466-8bdc-141f9ba53a83@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:2.0:1789265643.177816:0:17136:0:(genops.c:1385:class_connect()) connect: client c753e2cb-2e3c-4466-8bdc-141f9ba53a83, cookie 0xbbfdc9019c1d4aed 00000100:00080000:0.0:1789265643.178029:0:17123:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c753e2cb-2e3c-4466-8bdc-141f9ba53a83->MGS 00000020:01000004:0.0:1789265643.178054:0:17123:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789265643.178059:0:17123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789265643.178072:0:17123:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9376433acd28) 00000020:00000080:0.0:1789265643.178084:0:17123:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:2.0:1789265643.179616:0:17136:0:(import.c:65:import_set_state_nolock()) ffff9377582db800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265643.179721:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+5:3642:x1876180579040384:12345-0@lo:250:mount.lustre.0 Request processed in 1978us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265643.179731:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265643.180142:0:3642:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.142@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789265643.180153:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.142@tcp: connect to target with instance 0 00000100:00080000:0.0:1789265643.180160:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.142@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789265643.180166:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789265643.180169:0:3642:0:(import.c:65:import_set_state_nolock()) ffff93777f399000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789265643.180172:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789265643.180226:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789265643.180233:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3642:1876180579040384:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789265643.188760:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265643.189058:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789265643.189065:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789265643.190986:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789265643.190997:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789265643.191529:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789265643.191535:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789265643.192258:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265643.192511:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789265643.192515:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789265643.192810:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789265643.192816:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789265643.225163:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265643.225445:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789265643.225451:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789265643.226485:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789265643.226493:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789265643.226959:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265643.227149:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265643.227160:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789265643.227485:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789265643.227491:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789265643.228020:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265643.228162:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265643.228166:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789265643.228470:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789265643.228477:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789265643.228796:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265643.228940:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265643.228945:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789265643.229477:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789265643.229485:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789265643.245543:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265643.245773:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789265643.245777:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789265643.247445:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789265643.247454:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789265643.248624:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789265643.248632:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789265643.249571:0:17123:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789265643.249601:0:17123:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789265643.249607:0:17123:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789265643.249721:0:17123:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789265643.249750:0:17123:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.142@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789265643.249753:0:17123:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789265643.249754:0:17123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265643.249755:0:17123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265643.249756:0:17123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265643.249757:0:17123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265643.249758:0:17123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265643.249759:0:17123:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265643.249760:0:17123:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265643.249760:0:17123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265643.249761:0:17123:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265643.249763:0:17123:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789265643.249764:0:17123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265643.249765:0:17123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265643.249766:0:17123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265643.249766:0:17123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265643.249767:0:17123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265643.249767:0:17123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265643.249768:0:17123:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265643.249769:0:17123:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265643.249769:0:17123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265643.249770:0:17123:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265643.249793:0:17123:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789265643.249810:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579040512:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789265643.250070:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265643.250115:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff937758111240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265643.250119:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579040512 00000100:00100000:0.0:1789265643.250127:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579040512 00000100:00100000:0.0:1789265643.250171:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265643.250181:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+5:17123:x1876180579040512:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789265643.250229:0:17138:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789265643.250231:0:17138:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789265643.250234:0:17138:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789265643.250557:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789265643.251017:0:17138:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1789265643.252141:0:17160:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789265643.252147:0:17160:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1789265643.252150:0:17160:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789265643.252153:0:17160:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789265643.252336:0:17160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1789265643.252491:0:17138:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789265643.252502:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789265643.254063:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+5:17123:x1876180579040512:12345-0@lo:253:mount.lustre.0 Request processed in 3877us (3985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.254076:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265643.254098:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579040512:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789265643.254112:0:17123:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789265643.254115:0:17123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265643.254124:0:17123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265643.254126:0:17123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265643.254127:0:17123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265643.254128:0:17123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265643.254130:0:17123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265643.254131:0:17123:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265643.254133:0:17123:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265643.254134:0:17123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265643.254136:0:17123:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789265643.254154:0:17123:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93777f58d800 from lustre-MDT0000 10000000:01000000:1.0:1789265643.254180:0:17123:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789265643.254182:0:17123:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789265643.254186:0:17123:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9376433ab370 10000000:01000000:1.0:1789265643.254189:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265643.254194:0:17123:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9376433ab370 from 1 10000000:01000000:1.0:1789265643.254197:0:17123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789265643.254226:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265643.254234:0:17123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265643.254241:0:17123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265643.254256:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579040640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265643.254282:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265643.254456:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579040640 00000100:00100000:2.0:1789265643.254461:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579040640 00000100:00100000:2.0:1789265643.254493:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265643.254502:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+5:17123:x1876180579040640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265643.254514:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265643.254528:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9376435fd800/0xbbfdc9019c1d4b02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4afb expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.254549:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fd800/0xbbfdc9019c1d4b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4afb expref: 6 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.254557:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9376435fd800/0xbbfdc9019c1d4b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4afb expref: 6 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.254564:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd800, rc 0) 00000100:00100000:2.0:1789265643.254614:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+6:17123:x1876180579040640:12345-0@lo:101:mount.lustre.0 Request processed in 114us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265643.254623:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265643.254718:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377581119c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265643.254728:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579040640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265643.254736:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b02 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265643.254743:0:17123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4b02 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265643.254783:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579040768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265643.254800:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265643.254815:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377581119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.254830:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579040768 00000100:00100000:3.0:1789265643.254834:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579040768 00000100:00100000:3.0:1789265643.254932:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265643.254940:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+6:17123:x1876180579040768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265643.255015:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+6:17123:x1876180579040768:12345-0@lo:501:mount.lustre.0 Request processed in 76us (212us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265643.255022:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265643.255048:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579040768:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789265643.255073:0:17123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789265643.255102:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b02 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265643.255110:0:17123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b02 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265643.255115:0:17123:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93777f58d800 10000000:01000000:1.0:1789265643.255119:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789265643.255121:0:17123:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93777f58d800 10000000:01000000:1.0:1789265643.255123:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789265643.255125:0:17123:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93777f58d800 from 1 10000000:01000000:1.0:1789265643.255126:0:17123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789265643.255137:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d4b09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265643.255141:0:17123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d4b09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265643.255147:0:17123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d4b09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265643.255155:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579040896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265643.255176:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265643.255196:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377581119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.255206:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579040896 00000100:00100000:3.0:1789265643.255215:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579040896 00000100:00100000:3.0:1789265643.255265:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265643.255273:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+6:17123:x1876180579040896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265643.255280:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265643.255290:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377465a4400/0xbbfdc9019c1d4b10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4b09 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.255313:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377465a4400/0xbbfdc9019c1d4b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4b09 expref: 7 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.255322:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377465a4400/0xbbfdc9019c1d4b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4b09 expref: 7 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.255328:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a4400, rc 0) 00000100:00100000:3.0:1789265643.255364:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+7:17123:x1876180579040896:12345-0@lo:101:mount.lustre.0 Request processed in 92us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.255369:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265643.255430:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579040896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265643.255440:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d4b09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b10 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265643.255448:0:17123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d4b09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4b10 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265643.255458:0:17123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789265643.255503:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d4b09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b10 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265643.255511:0:17123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bd800/0xbbfdc9019c1d4b09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b10 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265643.255515:0:17123:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789265643.255518:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265643.255521:0:17123:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93777f58d800 10000000:01000000:1.0:1789265643.255523:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789265643.255525:0:17123:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789265643.255526:0:17123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265643.255535:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bde00/0xbbfdc9019c1d4b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265643.255539:0:17123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bde00/0xbbfdc9019c1d4b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265643.255544:0:17123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bde00/0xbbfdc9019c1d4b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265643.255556:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579041024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265643.255573:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265643.255588:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377581119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.255603:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579041024 00000100:00100000:3.0:1789265643.255607:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579041024 00000100:00100000:3.0:1789265643.255661:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789265643.255669:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+7:17123:x1876180579041024:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265643.255675:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265643.255683:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377465a4800/0xbbfdc9019c1d4b1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4b17 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.255695:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377465a4800/0xbbfdc9019c1d4b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4b17 expref: 8 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.255702:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377465a4800/0xbbfdc9019c1d4b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4b17 expref: 8 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.255714:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a4800, rc 0) 00000100:00100000:3.0:1789265643.255750:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+8:17123:x1876180579041024:12345-0@lo:101:mount.lustre.0 Request processed in 82us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.255755:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265643.255940:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579041024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265643.255948:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bde00/0xbbfdc9019c1d4b17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b1e expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265643.256170:0:17123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bde00/0xbbfdc9019c1d4b17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4b1e expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265643.256216:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579041152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265643.256239:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265643.256261:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377581119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.256268:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579041152 00000100:00100000:3.0:1789265643.256272:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579041152 00000100:00100000:0.0:1789265643.256365:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265643.256375:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+8:17123:x1876180579041152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265643.256494:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+9:17123:x1876180579041152:12345-0@lo:501:mount.lustre.0 Request processed in 121us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265643.256500:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265643.256554:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579041152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265643.256574:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579041280:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265643.256604:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265643.256619:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377581119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.256632:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579041280 00000100:00100000:3.0:1789265643.256636:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579041280 00000100:00100000:3.0:1789265643.256663:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265643.256670:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+9:17123:x1876180579041280:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265643.257358:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579041280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265643.257367:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+9:17123:x1876180579041280:12345-0@lo:503:mount.lustre.0 Request processed in 626us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.257374:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265643.257769:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17161:1876180579041408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265643.257795:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265643.257819:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff937758111180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.257828:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579041408 00000100:00100000:3.0:1789265643.257832:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579041408 00000100:00100000:3.0:1789265643.257942:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265643.257951:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+9:17161:x1876180579041408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265643.258516:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+9:17161:x1876180579041408:12345-0@lo:502:llog_process_th.0 Request processed in 565us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.258523:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265643.258572:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17161:1876180579041408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265643.258595:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265643.258610:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.258613:0:17161:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789265643.258618:0:17161:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789265643.258621:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265643.258635:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9376426f19b8) 00000020:00000080:1.0:1789265643.258648:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789265643.258652:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789265643.258720:0:17161:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789265643.258726:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d4b2c 00000020:00000080:1.0:1789265643.258910:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789265643.258915:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265643.258918:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.258920:0:17161:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789265643.258922:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265643.258925:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.258927:0:17161:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789265643.258930:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265643.258937:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9376426f0000) 00000020:00000080:1.0:1789265643.258947:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789265643.258950:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789265643.259026:0:17161:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789265643.259029:0:17161:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789265643.259037:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789265643.259073:0:17161:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93777f58d800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789265643.259152:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9376426f3370) 00000020:00000080:1.0:1789265643.259162:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789265643.259211:0:17161:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789265643.259216:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbbfdc9019c1d4b41 00000020:00000080:1.0:1789265643.259428:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789265643.259434:0:17161:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789265643.259439:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbbfdc9019c1d4b48 00080000:01000000:1.0:1789265643.259443:0:17161:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789265643.259449:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d4b4f 00010000:00010000:1.0:1789265643.306189:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789265643.307464:0:17161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:1.0:1789265643.307793:0:17161:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789265643.308998:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9376426f4d28) 00000020:00000080:1.0:1789265643.309018:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789265643.309201:0:17161:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789265643.309214:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d4b5d 00000020:00000080:1.0:1789265643.310995:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789265643.320796:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbbfdc9019c1d4b64 00000020:00000080:3.0:1789265643.322542:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789265643.322556:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265643.322565:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265643.322567:0:17161:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789265643.322571:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789265643.322574:0:17161:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789265643.322581:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265643.322583:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265643.322584:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789265643.322587:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265643.322589:0:17161:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789265643.322591:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265643.322596:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265643.322598:0:17161:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789265643.322604:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789265643.322658:0:17161:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789265643.322688:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265643.322692:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265643.322694:0:17161:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789265643.322697:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265643.322701:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265643.322702:0:17161:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789265643.322704:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265643.322710:0:17161:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:00000080:3.0:1789265643.322740:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265643.322757:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9376424f4d28) 00000020:00000080:3.0:1789265643.322775:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789265643.322780:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265643.322856:0:17161:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789265643.322887:0:17161:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789265643.322894:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d4b72 00010000:00080000:3.0:1789265643.322930:0:17161:0:(ldlm_lib.c:102:import_set_conn()) imp ffff937779e22800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1789265643.327133:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1789265643.329288:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789265643.329306:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789265643.329419:0:17161:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789265643.329441:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbbfdc9019c1d4b79 00000100:00080000:2.0:1789265643.329454:0:17161:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265643.329461:0:17161:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff937779e22800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1789265643.329501:0:17161:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93777f581f80 x1876180579041536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265643.329581:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579041536:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789265643.329652:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265643.329752:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579041536 00000100:00100000:1.0:1789265643.329759:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579041536 00000100:00100000:1.0:1789265643.329795:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265643.329804:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876180579041536:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1789265643.329820:0:17148:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1789265643.331509:0:17161:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1789265643.331672:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265643.331680:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265643.331682:0:17161:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789265643.331686:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789265643.331690:0:17161:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1789265643.331692:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265643.331694:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265643.331695:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789265643.331698:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265643.331699:0:17161:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789265643.331702:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789265643.331706:0:17161:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789265643.331709:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265643.331710:0:17161:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789265643.331713:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789265643.331717:0:17161:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:2.0:1789265643.331742:0:17161:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789265643.331744:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265643.331759:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93774f18b370) 00000020:00000080:2.0:1789265643.331781:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789265643.331794:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789265643.331891:0:17161:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789265643.331897:0:17161:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789265643.331905:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d4b87 00010000:00080000:2.0:1789265643.331936:0:17161:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93775dcee800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1789265643.333353:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789265643.335237:0:17161:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789265643.339971:0:17161:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789265643.343104:0:17161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265643.343302:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789265643.348078:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789265643.349673:0:17167:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789265643.349679:0:17167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1789265643.353587:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876180579041536:12345-0@lo:38:llog_process_th.0 Request processed in 23776us (23927us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789265643.353616:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789265643.353722:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937779e22800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265643.353729:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789265643.353733:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579041536:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1789265643.354244:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265643.354257:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789265643.354308:0:17161:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789265643.354337:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbbfdc9019c1d4b8e 00000100:00080000:3.0:1789265643.354345:0:17161:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265643.354351:0:17161:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93775dcee800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265643.354387:0:17161:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9376434d7800 x1876180579041664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265643.354410:0:17161:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789265643.354473:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265643.354478:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265643.354480:0:17161:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789265643.354483:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789265643.354486:0:17161:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1789265643.354487:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265643.354489:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265643.354490:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789265643.354492:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265643.354494:0:17161:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789265643.354497:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265643.354500:0:17161:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789265643.354503:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265643.354505:0:17161:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789265643.354508:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265643.354512:0:17161:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:3.0:1789265643.354536:0:17161:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789265643.354539:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265643.354551:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9376424f19b8) 00000020:00000080:3.0:1789265643.354562:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1789265643.354565:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265643.354634:0:17161:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789265643.354641:0:17161:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789265643.354647:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbbfdc9019c1d4b9c 00010000:00080000:3.0:1789265643.355367:0:17161:0:(ldlm_lib.c:102:import_set_conn()) imp ffff937760304800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1789265643.355622:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789265643.355693:0:17161:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789265643.355709:0:17161:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:0.0:1789265643.356280:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789265643.356285:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789265643.356288:0:8:0:(import.c:65:import_set_state_nolock()) ffff937779e22800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265643.356296:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:0.0:1789265643.356302:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789265643.356306:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff937779e22800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265643.356327:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37fb80 x1876180579041920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265643.356401:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3644:1876180579041792:0@lo:400:kworker.0 00000100:00100000:0.0:1789265643.356472:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265643.356629:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579041792 00000100:00100000:2.0:1789265643.356638:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579041792 00000100:00100000:2.0:1789265643.356692:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265643.356704:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+9:3644:x1876180579041792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265643.356764:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+9:3644:x1876180579041792:12345-0@lo:400:kworker.0 Request processed in 63us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265643.356772:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265643.356898:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3644:1876180579041792:0@lo:400:kworker.0 00000100:00100000:1.0:1789265643.357893:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579041664:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789265643.357939:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180579041664 offset 0 length 520: 4 00000100:00100000:1.0:1789265643.357970:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579041920:0@lo:38:kworker.0 00000100:00100000:1.0:1789265643.357999:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265643.358046:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579041920 00000100:00100000:1.0:1789265643.358052:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579041920 00000100:00100000:1.0:1789265643.359740:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265643.359755:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876180579041920:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789265643.359772:0:17149:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265643.360312:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876180579041920:12345-0@lo:38:kworker.0 Request processed in 557us (2309us total) trans 0 rc -19/-19 00000100:00080000:0.0:1789265643.360316:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937779e22800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265643.360323:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265643.360328:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579041920:0@lo:38:kworker.0 00000100:00100000:1.0:1789265643.360337:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:3.0:1789265643.360447:0:17161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265643.362301:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789265643.362576:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1789265643.363258:0:17169:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789265643.363264:0:17169:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789265643.363611:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789265643.363622:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789265643.363656:0:17161:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789265643.363685:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbbfdc9019c1d4ba3 00000100:00080000:1.0:1789265643.363696:0:17161:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265643.363701:0:17161:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff937760304800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1789265643.363734:0:17161:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f158000 x1876180579042048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265643.363763:0:17161:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789265643.363880:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265643.363886:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.363888:0:17161:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789265643.363891:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265643.363895:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.363896:0:17161:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789265643.363899:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789265643.363901:0:17161:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789265643.363904:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265643.363906:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.363908:0:17161:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789265643.363910:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265643.363912:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.363913:0:17161:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789265643.363916:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789265643.363945:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17161:1876180579042176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265643.364018:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265643.364051:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265643.364221:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579042048:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789265643.364250:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180579042048 offset 0 length 520: 4 00000100:00100000:3.0:1789265643.364382:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579042176 00000100:00100000:3.0:1789265643.364389:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579042176 00000100:00100000:3.0:1789265643.364432:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265643.364442:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+9:17161:x1876180579042176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265643.364564:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+9:17161:x1876180579042176:12345-0@lo:502:llog_process_th.0 Request processed in 118us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.364572:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265643.364794:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17161:1876180579042176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265643.364829:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265643.364834:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.364836:0:17161:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789265643.364839:0:17161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789265643.365278:0:17123:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1789265643.365300:0:17123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789265643.365363:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bde00/0xbbfdc9019c1d4b17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b1e expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.365375:0:17123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bde00/0xbbfdc9019c1d4b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b1e expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265643.365384:0:17123:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93777f58d800 from 1 10000000:01000000:2.0:1789265643.365387:0:17123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789265643.365417:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.365425:0:17123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.365448:0:17123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265643.365468:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579042304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265643.365506:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265643.365540:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760051b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.365590:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579042304 00000100:00100000:3.0:1789265643.365596:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579042304 00000100:00100000:3.0:1789265643.365629:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265643.365636:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+9:17123:x1876180579042304:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265643.365646:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265643.365660:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377465a5600/0xbbfdc9019c1d4bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4baa expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.365693:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377465a5600/0xbbfdc9019c1d4bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4baa expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.365703:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377465a5600/0xbbfdc9019c1d4bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4baa expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.365723:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a5600, rc 0) 00000100:00100000:3.0:1789265643.365762:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+10:17123:x1876180579042304:12345-0@lo:101:mount.lustre.0 Request processed in 126us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.365768:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265643.365905:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579042304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265643.365917:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4bb1 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.365926:0:17123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4bb1 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265643.366462:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579042432:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789265643.366498:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265643.366522:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760051b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.366646:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579042432 00000100:00100000:3.0:1789265643.366652:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579042432 00000100:00100000:3.0:1789265643.366693:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265643.366701:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+10:17123:x1876180579042432:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789265643.366716:0:17137:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789265643.366722:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789265643.366785:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+10:17123:x1876180579042432:12345-0@lo:256:mount.lustre.0 Request processed in 85us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.366792:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265643.366975:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579042432:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789265643.367578:0:17123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789265643.368870:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4bb1 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.368883:0:17123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4bb1 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265643.368891:0:17123:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93777f58d800 from 1 10000000:01000000:2.0:1789265643.368894:0:17123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265643.368936:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.368944:0:17123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.368954:0:17123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265643.368975:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579042560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265643.369028:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265643.369122:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760051b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.374558:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579042560 00000100:00100000:3.0:1789265643.374578:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579042560 00000100:00100000:3.0:1789265643.374673:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265643.374684:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+10:17123:x1876180579042560:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265643.374701:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265643.374722:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377465a5200/0xbbfdc9019c1d4bbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4bb8 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.374750:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377465a5200/0xbbfdc9019c1d4bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4bb8 expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.374762:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377465a5200/0xbbfdc9019c1d4bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4bb8 expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.374793:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a5200, rc 0) 00000100:00100000:3.0:1789265643.374892:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+11:17123:x1876180579042560:12345-0@lo:101:mount.lustre.0 Request processed in 210us (5863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.374899:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265643.374989:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579042560:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265643.375007:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4bbf expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.375015:0:17123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4bbf expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265643.375099:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579042688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265643.375132:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265643.375398:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760051b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265643.376878:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579042688 00000100:00100000:1.0:1789265643.376890:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579042688 00000100:00100000:1.0:1789265643.380408:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265643.380422:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+11:17123:x1876180579042688:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265643.380624:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+11:17123:x1876180579042688:12345-0@lo:501:mount.lustre.0 Request processed in 205us (5490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265643.380633:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265643.380730:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579042688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265643.380782:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579042816:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265643.380832:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265643.380895:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760051b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265643.380978:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579042816 00000100:00100000:1.0:1789265643.380984:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579042816 00000100:00100000:1.0:1789265643.381006:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789265643.381013:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+11:17123:x1876180579042816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265643.381108:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+11:17123:x1876180579042816:12345-0@lo:503:mount.lustre.0 Request processed in 94us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265643.381115:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265643.381248:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579042816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265643.381590:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17171:1876180579042944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265643.381623:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265643.381656:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377455379c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265643.381704:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579042944 00000100:00100000:2.0:1789265643.381709:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579042944 00000100:00100000:2.0:1789265643.381730:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265643.381735:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+11:17171:x1876180579042944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265643.382188:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+11:17171:x1876180579042944:12345-0@lo:502:llog_process_th.0 Request processed in 450us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265643.382195:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789265643.382330:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17171:1876180579042944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789265643.382354:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265643.382363:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.382365:0:17171:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789265643.382372:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93777f58d800 00000020:00000080:1.0:1789265643.382374:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265643.382391:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265643.382393:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.382394:0:17171:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789265643.382397:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265643.382399:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.382400:0:17171:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789265643.382403:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93777f58d800 00000020:00000080:1.0:1789265643.382405:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265643.382457:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265643.382461:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.382462:0:17171:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789265643.382464:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265643.382467:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.382468:0:17171:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789265643.382471:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93777f58d800 00000020:00000080:1.0:1789265643.382472:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265643.382489:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265643.382491:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.382493:0:17171:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789265643.382496:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265643.382498:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265643.382499:0:17171:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789265643.382502:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93777f58d800 00000020:00000080:1.0:1789265643.382504:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789265643.382535:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17171:1876180579043072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265643.382569:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265643.382590:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377455379c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.388193:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579043072 00000100:00100000:3.0:1789265643.388209:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579043072 00000100:00100000:3.0:1789265643.388269:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265643.388280:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+11:17171:x1876180579043072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265643.388472:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+11:17171:x1876180579043072:12345-0@lo:502:llog_process_th.0 Request processed in 193us (5901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.388480:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265643.388552:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17171:1876180579043072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265643.388583:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265643.388590:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265643.388592:0:17171:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789265643.388595:0:17171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789265643.392106:0:17123:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789265643.392143:0:17123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265643.392168:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4bbf expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.392181:0:17123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4bbf expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265643.392239:0:17123:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789265643.392242:0:17123:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93777f58d800 10000000:01000000:3.0:1789265643.392252:0:17123:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93777f58d800 10000000:01000000:3.0:1789265643.392257:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265643.392263:0:17123:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93777f58d800 from 1 10000000:01000000:3.0:1789265643.392266:0:17123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265643.392303:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377465a5800/0xbbfdc9019c1d4bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.392312:0:17123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377465a5800/0xbbfdc9019c1d4bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.392323:0:17123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377465a5800/0xbbfdc9019c1d4bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265643.392348:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579043200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265643.392413:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265643.392455:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744664000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.392479:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579043200 00000100:00100000:3.0:1789265643.392486:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579043200 00000100:00100000:3.0:1789265643.392535:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265643.392544:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+11:17123:x1876180579043200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265643.392556:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265643.392569:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377465a4c00/0xbbfdc9019c1d4bcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4bc6 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.392591:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377465a4c00/0xbbfdc9019c1d4bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4bc6 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.392601:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377465a4c00/0xbbfdc9019c1d4bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4bc6 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.392619:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a4c00, rc 0) 00000100:00100000:3.0:1789265643.392656:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17123:x1876180579043200:12345-0@lo:101:mount.lustre.0 Request processed in 113us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.392664:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265643.392711:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579043200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265643.392725:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377465a5800/0xbbfdc9019c1d4bc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4bcd expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.392733:0:17123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377465a5800/0xbbfdc9019c1d4bc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4bcd expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265643.392785:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579043328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265643.392809:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265643.392824:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744664000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.392837:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579043328 00000100:00100000:3.0:1789265643.392840:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579043328 00000100:00100000:3.0:1789265643.392880:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789265643.392887:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17123:x1876180579043328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265643.392995:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17123:x1876180579043328:12345-0@lo:501:mount.lustre.0 Request processed in 108us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.393002:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789265643.393032:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579043328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265643.393056:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579043456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265643.393105:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265643.393124:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744664000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.393135:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579043456 00000100:00100000:3.0:1789265643.393138:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579043456 00000100:00100000:3.0:1789265643.393154:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789265643.393159:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17123:x1876180579043456:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265643.393225:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17123:x1876180579043456:12345-0@lo:503:mount.lustre.0 Request processed in 65us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.393231:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789265643.393271:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579043456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265643.400039:0:17175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17175:1876180579043584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265643.400145:0:17175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265643.400184:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579043584 00000100:00100000:3.0:1789265643.400192:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579043584 00000100:00100000:3.0:1789265643.400236:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265643.400245:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17175:x1876180579043584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265643.400368:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17175:x1876180579043584:12345-0@lo:502:llog_process_th.0 Request processed in 124us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.400377:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265643.400428:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744664cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.400449:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17175:1876180579043584:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789265643.400504:0:17175:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789265643.400519:0:17175:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9376424f0000) 00000020:00000080:3.0:1789265643.400541:0:17175:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789265643.400618:0:17175:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93777f58d800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789265643.400623:0:17175:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93777f58d800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789265643.400625:0:17175:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93777f58d800 4 00010000:00080000:3.0:1789265643.400657:0:17175:0:(ldlm_lib.c:102:import_set_conn()) imp ffff937747e2c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1789265643.402298:0:17175:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789265643.402502:0:17175:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789265643.402542:0:17175:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789265643.402557:0:17175:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbbfdc9019c1d4bdb 00000100:00080000:3.0:1789265643.402567:0:17175:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265643.402572:0:17175:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff937747e2c000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265643.402604:0:17175:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9376434d5f80 x1876180579043712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265643.402634:0:17175:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789265643.405241:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180579043712:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789265643.405323:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265643.406333:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579043712 00000100:00100000:3.0:1789265643.406344:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579043712 00000100:00100000:3.0:1789265643.406384:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265643.406392:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876180579043712:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789265643.406473:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876180579043712:12345-0@lo:38:llog_process_th.0 Request processed in 80us (1149us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789265643.406480:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265643.406605:0:17175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17175:1876180579043840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265643.410608:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265643.410625:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937747e2c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265643.410632:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789265643.410637:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180579043712:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789265643.421844:0:17175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265643.421917:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744664c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265643.421921:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579043840 00000100:00100000:0.0:1789265643.421932:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579043840 00000100:00100000:0.0:1789265643.422045:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265643.422058:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17175:x1876180579043840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265643.422246:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17175:x1876180579043840:12345-0@lo:502:llog_process_th.0 Request processed in 190us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265643.422254:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265643.422408:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17175:1876180579043840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265643.422476:0:17175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17175:1876180579043968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265643.422513:0:17175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265643.422535:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579043968 00000100:00100000:3.0:1789265643.422538:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579043968 00000100:00100000:3.0:1789265643.422563:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265643.422569:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17175:x1876180579043968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265643.422637:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17175:x1876180579043968:12345-0@lo:502:llog_process_th.0 Request processed in 67us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.422643:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265643.422684:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff937758111240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265643.422696:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17175:1876180579043968:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789265643.422715:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789265643.422793:0:17123:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789265643.422825:0:17123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789265643.422843:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377465a5800/0xbbfdc9019c1d4bc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4bcd expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265643.422854:0:17123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377465a5800/0xbbfdc9019c1d4bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4bcd expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789265643.422936:0:17123:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789265643.422939:0:17123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265643.422941:0:17123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265643.422943:0:17123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265643.422944:0:17123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265643.422946:0:17123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265643.422948:0:17123:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265643.422949:0:17123:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265643.422952:0:17123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265643.422953:0:17123:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789265643.422958:0:17123:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789265643.422961:0:17123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265643.422962:0:17123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265643.422964:0:17123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265643.422965:0:17123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265643.422966:0:17123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265643.422967:0:17123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265643.422968:0:17123:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265643.422969:0:17123:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265643.422976:0:17123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265643.422977:0:17123:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789265643.422989:0:17123:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789265643.423000:0:17123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579044096:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789265643.423030:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265643.423056:0:17123:0:(client.c:2715:ptlrpc_set_wait()) set ffff937758111240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265643.423249:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579044096 00000100:00100000:0.0:1789265643.423254:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579044096 00000100:00100000:0.0:1789265643.423330:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265643.423342:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17123:x1876180579044096:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789265643.423364:0:17138:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789265643.423378:0:17138:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789265643.425391:0:17138:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789265643.425404:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789265643.425417:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789265643.425422:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789265643.425445:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265643.425463:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377465a5600/0xbbfdc9019c1d4bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4baa expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265643.425472:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265643.425505:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377465a5600/0xbbfdc9019c1d4bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d4baa expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265643.425520:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9377465a5600/0xbbfdc9019c1d4bb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4baa expref: 12 pid: 17138 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265643.425542:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1876180579044224:0@lo:104: 00000100:00100000:0.0:1789265643.425604:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265643.428187:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775f5ae3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265643.428566:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17123:x1876180579044096:12345-0@lo:253:mount.lustre.0 Request processed in 5223us (5531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265643.428578:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789265643.429410:0:17123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17123:1876180579044096:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789265643.429427:0:17123:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789265643.429430:0:17123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265643.429432:0:17123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789265643.429433:0:17123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265643.429434:0:17123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265643.429435:0:17123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265643.429437:0:17123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265643.429438:0:17123:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265643.429439:0:17123:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789265643.429441:0:17123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265643.429443:0:17123:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789265643.429459:0:17123:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789265643.430069:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579044224 00000100:00100000:2.0:1789265643.430154:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579044224 00000100:00100000:2.0:1789265643.430246:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265643.430257:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+3:17159:x1876180579044224:12345-0@lo:104: 00010000:00010000:2.0:1789265643.430276:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4bb1 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.430358:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265643.430364:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+3:17159:x1876180579044224:12345-0@lo:104: Request processed in 110us (4759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265643.430372:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265643.434973:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1876180579044224:0@lo:104: 00010000:00010000:1.0:1789265643.435098:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437313:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265643.437330:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4bb1 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437343:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd200 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265643.437348:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d4bb1 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437360:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d4bb1 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265643.437381:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d4bb1 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265643.437387:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265643.437452:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4bb1 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437459:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265643.437488:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4bb1 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437495:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9376435fd200/0xbbfdc9019c1d4baa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4bb1 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437516:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265643.437518:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265643.437519:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265643.437563:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579044352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265643.437626:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265643.437727:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579044352 00000100:00100000:2.0:1789265643.437734:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579044352 00010000:00010000:2.0:1789265643.437762:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377465a5600/0xbbfdc9019c1d4bb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4baa expref: 12 pid: 17138 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265643.437798:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265643.437807:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:3645:x1876180579044352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265643.437821:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265643.437827:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377465a5600/0xbbfdc9019c1d4bb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4baa expref: 12 pid: 17138 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437846:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377465a5600/0xbbfdc9019c1d4bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4baa expref: 12 pid: 17138 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437895:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377465a5600/0xbbfdc9019c1d4bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d4baa expref: 12 pid: 17138 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437911:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437920:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265643.437936:0:17129:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012514975s 00010000:00010000:2.0:1789265643.437941:0:17129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437949:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437956:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437964:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437969:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:2.0:1789265643.437974:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.437982:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.438003:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265643.438013:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265643.438031:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265643.438049:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265643.438057:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+11:3645:x1876180579044352:12345-0@lo:103:ldlm_bl.0 Request processed in 248us (427us total) trans 0 rc 0/0 00010000:00010000:1.0:1789265643.438060:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937642392600/0xbbfdc9019c1d4be2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265643.438071:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265643.438204:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579044352:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789265643.465235:0:17123:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789265643.465549:0:17123:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1789265643.466468:0:17184:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789265643.466727:0:17123:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:2.0:1789265643.467236:0:17123:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789265643.467282:0:17123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789265643.467694:0:17123:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789265643.467702:0:17123:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789265643.467735:0:17123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265643.468714:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789265643.469294:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789265643.469328:0:17123:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00080000:2.0:1789265643.469658:0:17185:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff93777f582a00 x1876180579044480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265643.469671:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00000040:00080000:3.0:1789265643.470902:0:17184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265643.472966:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789265643.473056:0:17184:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:0.0:1789265643.473429:0:17183:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789265643.473434:0:17183:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00080000:10000000:2.0:1789265643.476786:0:17123:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1789265643.484786:0:17123:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789265643.493204:0:17123:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789265643.493257:0:17123:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa6058148b988 00100000:10000000:2.0:1789265643.493266:0:17123:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789265643.494486:0:17123:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789265643.494501:0:17123:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789265643.494521:0:17123:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789265643.494543:0:17123:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789265643.496277:0:17123:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265643.497593:0:17123:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265644.215527:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265644.489971:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789265644.531018:0:17141:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789265644.531027:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93777f58d800 from 7 10000000:01000000:1.0:1789265644.531032:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265644.531090:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265644.531104:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265644.531116:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265644.531146:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579044608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265644.531222:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265644.531275:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265644.531384:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579044608 00000100:00100000:3.0:1789265644.531392:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579044608 00000100:00100000:3.0:1789265644.531458:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265644.531468:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643513450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+11:17141:x1876180579044608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265644.531483:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265644.531708:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377465a5000/0xbbfdc9019c1d4bf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4be9 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265644.531735:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377465a5000/0xbbfdc9019c1d4bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4be9 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265644.531747:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377465a5000/0xbbfdc9019c1d4bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4be9 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265644.531756:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a5000, rc 0) 00000100:00100000:3.0:1789265644.531808:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643513450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17141:x1876180579044608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 342us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265644.531815:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265644.531962:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579044608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265644.531977:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4bf0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265644.531986:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4bf0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265644.532038:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579044736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789265644.532088:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265644.532112:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265644.532705:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00000100:00100000:3.0:1789265644.533119:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579044736 00000100:00100000:3.0:1789265644.533128:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579044736 00000100:00100000:3.0:1789265644.533173:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265644.533181:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17141:x1876180579044736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789265644.533200:0:17138:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789265644.533218:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789265644.533221:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789265644.533317:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17141:x1876180579044736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265644.533325:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265644.538892:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579044736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789265644.538979:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265644.538990:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4bf0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265644.539001:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4bf0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265645.237185:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265645.493257:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789265645.556061:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00010000:00010000:0.0:1789265646.259705:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265646.579473:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00010000:00010000:3.0:1789265647.282976:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265647.603486:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00010000:00010000:0.0:1789265648.317937:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265648.632393:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00000100:00080000:0.0:1789265648.632507:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:3.0:1789265648.632584:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265648.632604:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579044864:0@lo:400:kworker.0 00000100:00100000:3.0:1789265648.632694:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265648.632773:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579044864 00000100:00100000:3.0:1789265648.632781:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579044864 00000100:00100000:3.0:1789265648.632828:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265648.632838:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:3645:x1876180579044864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265648.632915:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:3645:x1876180579044864:12345-0@lo:400:kworker.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265648.632924:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265648.632971:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579044864:0@lo:400:kworker.0 00000100:00080000:0.0:1789265648.633176:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789265648.633180:0:8:0:(import.c:65:import_set_state_nolock()) ffff937779e22800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265648.633186:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:0.0:1789265648.633190:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789265648.633195:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff937779e22800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265648.633232:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37d500 x1876180579044992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265648.633246:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265648.633250:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265648.633253:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265648.633256:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265648.633259:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789265648.633261:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789265648.633263:0:8:0:(import.c:65:import_set_state_nolock()) ffff937747e2c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265648.633268:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff937747e2c000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265648.633280:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37f100 x1876180579045120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265648.633347:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579044992:0@lo:38:kworker.0 00000100:00100000:2.0:1789265648.633387:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265648.633415:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180579045120:0@lo:38:kworker.0 00000100:00100000:2.0:1789265648.633442:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265648.633538:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579045120 00000100:00100000:3.0:1789265648.633543:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579045120 00000100:00100000:3.0:1789265648.633572:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265648.633578:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876180579045120:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789265648.633601:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:3.0:1789265648.633636:0:17145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbbfdc9019c1d4bf7 00000004:00100000:3.0:1789265648.633653:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789265648.634018:0:17145:0:(import.c:65:import_set_state_nolock()) ffff937642138800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265648.634084:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180579045120:12345-0@lo:38:kworker.0 Request processed in 504us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265648.634092:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789265648.634129:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93774f37f100 x1876180579045120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789265648.634142:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789265648.634150:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789265648.634154:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789265648.634156:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937747e2c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789265648.634162:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180579045120:0@lo:38:kworker.0 00000100:00100000:0.0:1789265648.642605:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579044992 00000100:00100000:0.0:1789265648.642626:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579044992 00000100:00100000:0.0:1789265648.642694:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265648.642703:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876180579044992:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789265648.642725:0:17148:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265648.687023:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876180579044992:12345-0@lo:38:kworker.0 Request processed in 44313us (53628us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265648.687058:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789265648.687371:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937779e22800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265648.687377:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265648.687382:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579044992:0@lo:38:kworker.0 00000001:02000400:2.0:1789265649.038177:0:17428:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789265649.331251:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265649.652051:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00000020:00000004:3.0:1789265649.875537:0:17480:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265649.876248:0:17480:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789265650.362460:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265650.675196:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00000020:00000004:1.0:1789265650.680310:0:17530:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265650.680639:0:17530:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789265651.379290:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265651.701177:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00010000:00010000:1.0:1789265652.416121:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265652.730550:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00010000:00010000:2.0:1789265653.428887:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265653.749641:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00000100:00080000:0.0:1789265653.753766:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789265653.753773:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789265653.753777:0:37:0:(import.c:65:import_set_state_nolock()) ffff937779e22800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265653.753799:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:0.0:1789265653.753804:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789265653.753812:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff937779e22800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265653.753839:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37ca80 x1876180579045376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265653.753878:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265653.753882:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265653.753885:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265653.753888:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789265653.753925:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579045248:0@lo:400:kworker.0 00000100:00100000:0.0:1789265653.754007:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265653.754062:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265653.754067:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579045504:0@lo:400:kworker.0 00000100:00100000:0.0:1789265653.754097:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265653.754134:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265643/real 1789265643] req@ffff93774f158000 x1876180579042048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265653 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265653.754153:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93774f158000 x1876180579042048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265653 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265653.754163:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265643/real 1789265643] req@ffff9376434d7800 x1876180579041664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265653 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265653.754174:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9376434d7800 x1876180579041664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265653 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265653.754184:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579045376:0@lo:38:kworker.0 00000100:00100000:0.0:1789265653.754219:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789265653.754238:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937760304800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265653.754252:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789265653.754255:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579042048:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789265653.754260:0:3642:0:(import.c:65:import_set_state_nolock()) ffff93775dcee800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265653.754265:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789265653.754267:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579041664:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789265653.754312:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579045504 00000100:00100000:0.0:1789265653.754320:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579045504 00000100:00100000:0.0:1789265653.754364:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265653.754374:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579045504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265653.754425:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579045504:12345-0@lo:400:kworker.0 Request processed in 52us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265653.754433:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265653.754457:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579045376 00000100:00100000:0.0:1789265653.754460:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579045376 00000100:00100000:0.0:1789265653.754478:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265653.754483:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876180579045376:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789265653.754499:0:17149:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265653.756106:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579045248 00000100:00100000:1.0:1789265653.756118:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579045248 00000100:00100000:1.0:1789265653.756178:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789265653.756187:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:3643:x1876180579045248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265653.756259:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:3643:x1876180579045248:12345-0@lo:400:kworker.0 Request processed in 73us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265653.756266:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789265653.758439:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265653.758447:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789265653.758452:0:37:0:(import.c:65:import_set_state_nolock()) ffff93775dcee800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265653.758458:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:1.0:1789265653.758464:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789265653.758470:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93775dcee800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1789265653.758514:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f15b100 x1876180579045632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265653.758536:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265653.758540:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789265653.758548:0:37:0:(import.c:65:import_set_state_nolock()) ffff937760304800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265653.758552:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:1.0:1789265653.767082:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789265653.767095:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff937760304800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1789265653.767139:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f158000 x1876180579045760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265653.767304:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579045632:0@lo:8:kworker.0 00000400:00000100:1.0:1789265653.767364:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180579045632 offset 0 length 520: 4 00000100:00100000:1.0:1789265653.767407:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579045760:0@lo:8:kworker.0 00000400:00000100:1.0:1789265653.767429:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180579045760 offset 0 length 520: 4 00010000:00080000:1.0:1789265653.767484:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93774f37ed80 x1876180579045504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265653.767498:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579045504:0@lo:400:kworker.0 00000100:00100000:1.0:1789265653.767510:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579045248:0@lo:400:kworker.0 00000100:00100000:0.0:1789265653.786761:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876180579045376:12345-0@lo:38:kworker.0 Request processed in 32266us (32530us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789265653.786778:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789265653.791297:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937779e22800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265653.791312:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789265653.791318:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579045376:0@lo:38:kworker.0 00010000:00010000:1.0:1789265654.451947:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265654.775044:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00010000:00010000:1.0:1789265655.478284:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265655.734468:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789265655.795134:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00010000:00010000:1.0:1789265656.499924:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265656.819368:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00010000:00010000:0.0:1789265657.524411:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265657.845264:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00010000:00010000:3.0:1789265658.555232:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789265658.748421:0:17876:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789265658.748426:0:17876:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789265658.748428:0:17876:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789265658.748555:0:17876:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93775f5f4800 00000020:01000004:2.0:1789265658.748574:0:17876:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789265658.748587:0:17876:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789265658.748600:0:17876:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff93774f188000) 00000020:00000080:2.0:1789265658.748617:0:17876:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789265658.835486:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1789265658.837555:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789265658.847902:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789265658.848299:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789265658.848560:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789265658.849218:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789265658.849425:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789265658.849613:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789265658.849957:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789265658.850171:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789265658.850380:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789265658.854360:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789265658.859001:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789265658.859506:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789265658.862762:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1789265658.863472:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789265658.863681:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789265658.863932:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1789265658.864820:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789265658.865167:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1789265658.865475:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789265658.866530:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00000100:00100000:0.0:1789265658.869086:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00100000:10000000:1.0:1789265658.870376:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1789265658.870678:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789265658.871023:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789265658.871232:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789265658.871439:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789265658.871626:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789265658.872020:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789265658.873079:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00000100:00100000:3.0:1789265658.873549:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579045888:0@lo:400:kworker.0 00000100:00100000:3.0:1789265658.873631:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265658.873760:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579045888 00000100:00100000:0.0:1789265658.873769:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579045888 00000100:00100000:0.0:1789265658.873828:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265658.873838:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:3645:x1876180579045888:12345-0@lo:400:kworker.0 00100000:10000000:1.0:1789265658.873982:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00000100:00080000:2.0:1789265658.874374:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789265658.874379:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789265658.874383:0:38:0:(import.c:65:import_set_state_nolock()) ffff937779e22800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265658.874388:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 509 00000100:00080000:2.0:1789265658.874399:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789265658.874405:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff937779e22800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1789265658.874434:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93777f583800 x1876180579046016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265658.874455:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265658.874459:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265658.874462:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265658.874464:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789265658.874622:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180579046144:0@lo:400:kworker.0 00000100:00100000:1.0:1789265658.874662:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:1.0:1789265658.874918:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789265658.875283:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789265658.875535:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789265658.876500:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789265658.876850:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789265658.877173:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789265658.877575:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789265658.878166:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00000100:00100000:0.0:1789265658.878556:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:3645:x1876180579045888:12345-0@lo:400:kworker.0 Request processed in 4713us (4918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265658.878570:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265658.878691:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579045888:0@lo:400:kworker.0 00000100:00100000:3.0:1789265658.878731:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579046144 00000100:00100000:3.0:1789265658.878891:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579046144 00100000:10000000:1.0:1789265658.879061:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00000100:00100000:3.0:1789265658.879320:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265658.879330:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180579046144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265658.879414:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180579046144:12345-0@lo:400:kworker.0 Request processed in 86us (4752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265658.879421:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789265658.879456:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93777f581180 x1876180579046144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265658.879468:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180579046144:0@lo:400:kworker.0 00100000:10000000:1.0:1789265658.879533:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1789265658.879817:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789265658.880254:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00000100:00100000:0.0:1789265658.880555:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579046016:0@lo:38:kworker.0 00000100:00100000:0.0:1789265658.880604:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265658.880744:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579046016 00000100:00100000:1.0:1789265658.880749:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579046016 00000100:00100000:1.0:1789265658.880776:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265658.880780:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876180579046016:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789265658.880795:0:17148:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00100000:10000000:3.0:1789265658.885486:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1789265658.886932:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1789265658.887503:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00080000:01000000:3.0:1789265658.888299:0:17876:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789265658.888518:0:17876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789265658.888533:0:17876:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789265658.888546:0:17876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbbfdc9019c1d4c05 00000020:01000004:3.0:1789265658.888554:0:17876:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789265658.888577:0:17876:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789265658.888580:0:17876:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789265658.888586:0:17876:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789265658.888611:0:17876:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789265658.888615:0:17876:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789265658.899300:0:17876:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789265658.899357:0:17876:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.142@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1789265658.899362:0:17876:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789265658.899364:0:17876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789265658.899366:0:17876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265658.899367:0:17876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265658.899368:0:17876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265658.899369:0:17876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265658.899371:0:17876:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265658.899372:0:17876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265658.899373:0:17876:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265658.899377:0:17876:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1789265658.899379:0:17876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265658.899380:0:17876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789265658.899381:0:17876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265658.899382:0:17876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265658.899383:0:17876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265658.899384:0:17876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265658.899385:0:17876:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265658.899386:0:17876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265658.899387:0:17876:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789265658.899415:0:17876:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789265658.899440:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579046272:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789265658.899513:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265658.899660:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579046272 00000100:00100000:0.0:1789265658.899668:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579046272 00000100:00100000:0.0:1789265658.899725:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265658.899734:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17876:x1876180579046272:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789265658.899780:0:17137:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789265658.899784:0:17137:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789265658.899792:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789265658.900220:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17876:x1876180579046272:12345-0@lo:253:mount.lustre.0 Request processed in 486us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265658.900228:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789265658.901587:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876180579046016:12345-0@lo:38:kworker.0 Request processed in 20798us (20975us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265658.901598:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789265658.902000:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937779e22800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265658.902006:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265658.902010:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579046016:0@lo:38:kworker.0 00000100:00100000:2.0:1789265658.902268:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff937757b13780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265658.902289:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579046272:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789265658.902303:0:17876:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789265658.902306:0:17876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789265658.902308:0:17876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789265658.902309:0:17876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265658.902310:0:17876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265658.902311:0:17876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265658.902313:0:17876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265658.902314:0:17876:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789265658.902316:0:17876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265658.902317:0:17876:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789265658.902335:0:17876:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93775f5f4800 from lustre-MDT0001 10000000:01000000:2.0:1789265658.902369:0:17876:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789265658.902373:0:17876:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789265658.902379:0:17876:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9376433ab370 local copy 00010000:00010000:2.0:1789265658.902390:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b02 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265658.902493:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579046400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265658.902536:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265658.902587:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265658.902672:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579046400 00000100:00100000:3.0:1789265658.902679:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579046400 00000100:00100000:3.0:1789265658.902728:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789265658.902747:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17876:x1876180579046400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265658.902826:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17876:x1876180579046400:12345-0@lo:501:mount.lustre.0 Request processed in 90us (289us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265658.902833:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265658.903348:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579046400:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789265658.903366:0:17876:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789265658.903387:0:17876:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789265658.903394:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b02 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265658.903404:0:17876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b02 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265658.903431:0:17876:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93775f5f4800 10000000:01000000:2.0:1789265658.903437:0:17876:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789265658.903443:0:17876:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9376433ab370 10000000:01000000:2.0:1789265658.903445:0:17876:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789265658.903448:0:17876:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9376433ab370 from 1 10000000:01000000:2.0:1789265658.903450:0:17876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789265658.903475:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc400/0xbbfdc9019c1d4c0c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265658.903483:0:17876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fc400/0xbbfdc9019c1d4c0c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265658.903492:0:17876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fc400/0xbbfdc9019c1d4c0c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265658.903505:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579046528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265658.903532:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265658.903565:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265658.903620:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579046528 00000100:00100000:1.0:1789265658.903624:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579046528 00000100:00100000:1.0:1789265658.903666:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265658.903673:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+12:17876:x1876180579046528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265658.903683:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265658.903696:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bdc00/0xbbfdc9019c1d4c13 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4c0c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265658.903718:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bdc00/0xbbfdc9019c1d4c13 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4c0c expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265658.903728:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bdc00/0xbbfdc9019c1d4c13 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4c0c expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265658.903746:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bdc00, rc 0) 00000100:00100000:1.0:1789265658.903781:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+13:17876:x1876180579046528:12345-0@lo:101:mount.lustre.0 Request processed in 108us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265658.903787:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265658.903901:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579046528:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265658.903918:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fc400/0xbbfdc9019c1d4c0c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4c13 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265658.903927:0:17876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fc400/0xbbfdc9019c1d4c0c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4c13 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265658.903960:0:17876:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789265658.903975:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc400/0xbbfdc9019c1d4c0c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4c13 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265658.903983:0:17876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fc400/0xbbfdc9019c1d4c0c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4c13 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265658.903991:0:17876:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93775f5f4800 10000000:01000000:2.0:1789265658.903994:0:17876:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789265658.903997:0:17876:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93775f5f4800 from 1 10000000:01000000:2.0:1789265658.903999:0:17876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789265658.904012:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d4c1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265658.904019:0:17876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d4c1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265658.904027:0:17876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d4c1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265658.904038:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579046656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265658.904061:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265658.904077:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265658.904192:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579046656 00000100:00100000:1.0:1789265658.904196:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579046656 00000100:00100000:1.0:1789265658.904225:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265658.904231:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+13:17876:x1876180579046656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265658.904238:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265658.904248:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bd200/0xbbfdc9019c1d4c21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4c1a expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265658.904261:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bd200/0xbbfdc9019c1d4c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4c1a expref: 14 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265658.904270:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bd200/0xbbfdc9019c1d4c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4c1a expref: 14 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265658.904287:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd200, rc 0) 00000100:00100000:1.0:1789265658.904312:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+14:17876:x1876180579046656:12345-0@lo:101:mount.lustre.0 Request processed in 81us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265658.904318:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265658.904389:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579046656:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265658.904399:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d4c1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4c21 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265658.904407:0:17876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d4c1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4c21 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265658.904417:0:17876:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789265658.904430:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d4c1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4c21 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265658.904438:0:17876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fcc00/0xbbfdc9019c1d4c1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4c21 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265658.904444:0:17876:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789265658.904447:0:17876:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789265658.904451:0:17876:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93775f5f4800 10000000:01000000:2.0:1789265658.904453:0:17876:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789265658.904456:0:17876:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789265658.904458:0:17876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789265658.904469:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d4c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265658.904476:0:17876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d4c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265658.904483:0:17876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d4c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265658.904493:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579046784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265658.904520:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265658.904529:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265658.904579:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579046784 00000100:00100000:1.0:1789265658.904583:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579046784 00000100:00100000:1.0:1789265658.904607:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265658.904613:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+14:17876:x1876180579046784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265658.904619:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265658.904626:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bca00/0xbbfdc9019c1d4c2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4c28 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265658.904638:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bca00/0xbbfdc9019c1d4c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4c28 expref: 15 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265658.904646:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bca00/0xbbfdc9019c1d4c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4c28 expref: 15 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265658.904653:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bca00, rc 0) 00000100:00100000:1.0:1789265658.904675:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+15:17876:x1876180579046784:12345-0@lo:101:mount.lustre.0 Request processed in 63us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265658.904681:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789265658.904757:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579046784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265658.904766:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d4c28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4c2f expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265658.904773:0:17876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d4c28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4c2f expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265658.906101:0:17876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1789265658.906735:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265658.913256:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789265658.913330:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1789265658.913344:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1789265658.913356:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1789265658.913370:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1789265658.913385:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1789265658.913399:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1789265658.913415:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1789265658.913429:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1789265658.913443:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1789265658.913456:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1789265658.913470:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1789265658.913484:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1789265658.913498:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1789265658.913512:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1789265658.913524:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1789265658.913538:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1789265658.913550:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1789265658.913563:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1789265658.913575:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1789265658.913604:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1789265658.913616:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1789265658.913627:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1789265658.913653:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1789265658.913657:0:17876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1789265658.913760:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579046912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265658.913831:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265658.913911:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265658.914283:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579046912 00000100:00100000:1.0:1789265658.914291:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579046912 00000100:00100000:1.0:1789265658.914351:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265658.914364:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+15:17876:x1876180579046912:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265658.914556:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+15:17876:x1876180579046912:12345-0@lo:501:mount.lustre.0 Request processed in 189us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265658.914572:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265658.914670:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579046912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265658.914709:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579047040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265658.914758:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265658.914788:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775f5ae000 going to sleep for 11 seconds 00000100:00100000:0.0:1789265658.914883:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579047040 00000100:00100000:0.0:1789265658.914888:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579047040 00000100:00100000:0.0:1789265658.914920:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789265658.914931:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+15:17876:x1876180579047040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265658.915735:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+15:17876:x1876180579047040:12345-0@lo:503:mount.lustre.0 Request processed in 804us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265658.915753:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789265658.915904:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579047040:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789265658.917249:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265658.917353:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579047168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265658.917418:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265658.917459:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265658.917541:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579047168 00000100:00100000:2.0:1789265658.917549:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579047168 00000100:00100000:2.0:1789265658.917600:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265658.917607:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+15:17876:x1876180579047168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265658.921049:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+15:17876:x1876180579047168:12345-0@lo:502:mount.lustre.0 Request processed in 3430us (3618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265658.921065:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789265658.921284:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579047168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789265658.921569:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789265658.921600:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1789265658.921615:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1789265658.921629:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1789265658.921643:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1789265658.921658:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1789265658.921671:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1789265658.921684:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1789265658.921695:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1789265658.921706:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1789265658.921717:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1789265658.921729:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1789265658.921819:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1789265658.921838:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1789265658.921851:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1789265658.922026:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1789265658.922043:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1789265658.922057:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1789265658.922071:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1789265658.922083:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1789265658.922095:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1789265658.922108:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1789265658.922138:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1789265658.922153:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1789265658.922165:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1789265658.922176:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1789265658.922186:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1789265658.922196:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1789265658.922206:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1789265658.922217:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1789265658.922228:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1789265658.922238:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1789265658.922262:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1789265658.922276:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1789265658.922287:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1789265658.922297:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1789265658.922308:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1789265658.922319:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1789265658.922344:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1789265658.922358:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1789265658.922370:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1789265658.922381:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1789265658.922393:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1789265658.922405:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1789265658.922446:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579047296:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265658.922511:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265658.922645:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745537180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265658.925396:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579047296 00000100:00100000:3.0:1789265658.925413:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579047296 00000100:00100000:2.0:1789265658.925566:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265658.925577:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+15:17876:x1876180579047296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265658.925767:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+15:17876:x1876180579047296:12345-0@lo:502:mount.lustre.0 Request processed in 192us (3255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265658.925775:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265658.926086:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579047296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265658.926179:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1789265658.926191:0:17876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1789265658.927162:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265658.927176:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265658.927178:0:17880:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789265658.927183:0:17880:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789265658.927185:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265658.927198:0:17880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9376424f3370) 00000020:00000080:3.0:1789265658.927218:0:17880:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789265658.927223:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789265658.927316:0:17880:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789265658.927324:0:17880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbbfdc9019c1d4c3d 00000020:00000080:3.0:1789265658.927550:0:17880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789265658.927555:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265658.927559:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265658.927561:0:17880:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789265658.927563:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265658.927567:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265658.927568:0:17880:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789265658.927571:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265658.927579:0:17880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff93775f540000) 00000020:00000080:3.0:1789265658.927590:0:17880:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789265658.927595:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789265658.927597:0:17880:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789265658.927600:0:17880:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789265658.927607:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789265658.927662:0:17880:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93775f5f4800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789265658.927676:0:17880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff93775f544d28) 00000020:00000080:3.0:1789265658.927685:0:17880:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1789265658.928101:0:17880:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789265658.928108:0:17880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbbfdc9019c1d4c52 00000020:00000080:0.0:1789265658.928199:0:17880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789265658.928205:0:17880:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789265658.928209:0:17880:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xbbfdc9019c1d4c59 00080000:01000000:0.0:1789265658.928214:0:17880:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789265658.928217:0:17880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbbfdc9019c1d4c60 00010000:00010000:2.0:1789265659.049256:0:17880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789265659.051399:0:17880:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789265659.052053:0:17880:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789265659.058421:0:17880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789265659.058439:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265659.058448:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265659.058451:0:17880:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789265659.058455:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265659.058462:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265659.058464:0:17880:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789265659.058468:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789265659.058483:0:17880:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:00000080:2.0:1789265659.058516:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265659.058544:0:17880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9377475d4d28) 00000020:00000080:2.0:1789265659.058571:0:17880:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1789265659.058578:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789265659.058678:0:17880:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789265659.058687:0:17880:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789265659.058695:0:17880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbbfdc9019c1d4c6e 00010000:00080000:2.0:1789265659.058729:0:17880:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93777aaea000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1789265659.078772:0:17880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1789265659.079661:0:17880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789265659.079676:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789265659.079712:0:17880:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789265659.079735:0:17880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbbfdc9019c1d4c75 00000100:00080000:3.0:1789265659.079745:0:17880:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265659.079751:0:17880:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93777aaea000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265659.079791:0:17880:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9376434d4380 x1876180579047424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265659.079817:0:17880:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1789265659.079907:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265659.079912:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.079914:0:17880:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789265659.079918:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789265659.079928:0:17880:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789265659.079930:0:17880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265659.079932:0:17880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265659.079934:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789265659.079938:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.079950:0:17880:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789265659.079954:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265659.079959:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.079960:0:17880:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789265659.079964:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789265659.079998:0:17880:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789265659.080011:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265659.080015:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.080016:0:17880:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789265659.080019:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789265659.080021:0:17880:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1789265659.080022:0:17880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265659.080024:0:17880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265659.080026:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789265659.080029:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.080031:0:17880:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789265659.080033:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265659.080037:0:17880:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789265659.080042:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.080043:0:17880:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789265659.080047:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265659.080051:0:17880:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:3.0:1789265659.080077:0:17880:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789265659.080080:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265659.080092:0:17880:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff93775f543370) 00000020:00000080:3.0:1789265659.080104:0:17880:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789265659.080109:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265659.080180:0:17880:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789265659.080187:0:17880:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789265659.080197:0:17880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbbfdc9019c1d4c83 00010000:00080000:3.0:1789265659.080229:0:17880:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9376424d5000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1789265659.080426:0:17880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:1.0:1789265659.080733:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265659.080738:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265659.080742:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265659.080745:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789265659.081289:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579047424:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789265659.081360:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265659.081504:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579047424 00000100:00100000:2.0:1789265659.081514:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579047424 00000100:00100000:2.0:1789265659.081557:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265659.081565:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876180579047424:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789265659.081590:0:17149:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:2.0:1789265659.081624:0:17149:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbbfdc9019c1d4c8a 00000004:00100000:2.0:1789265659.081639:0:17149:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789265659.081644:0:17149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:3.0:1789265659.086476:0:17880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789265659.089743:0:17880:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789265659.093361:0:17880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265659.094440:0:17880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789265659.094655:0:17880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1789265659.096076:0:17885:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789265659.096084:0:17885:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789265659.098898:0:17880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789265659.098912:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789265659.098974:0:17880:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789265659.098999:0:17880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbbfdc9019c1d4c91 00000100:00080000:3.0:1789265659.099012:0:17880:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265659.099018:0:17880:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9376424d5000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265659.099059:0:17880:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9376434d4e00 x1876180579047552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265659.099079:0:17880:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789265659.099132:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265659.099135:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.099137:0:17880:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789265659.099140:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789265659.099143:0:17880:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1789265659.099145:0:17880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265659.099146:0:17880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265659.099148:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00100000:0.0:1789265659.099318:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579047552:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789265659.099376:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180579047552 offset 0 length 520: 4 00000020:00000080:3.0:1789265659.099605:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.099608:0:17880:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789265659.099613:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265659.099617:0:17880:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789265659.099632:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.099633:0:17880:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789265659.099637:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265659.099641:0:17880:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:3.0:1789265659.099664:0:17880:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789265659.099667:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265659.099679:0:17880:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff93775f5419b8) 00000020:00000080:3.0:1789265659.099693:0:17880:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1789265659.099698:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265659.099760:0:17880:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789265659.099767:0:17880:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789265659.099772:0:17880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbbfdc9019c1d4c9f 00010000:00080000:3.0:1789265659.099812:0:17880:0:(ldlm_lib.c:102:import_set_conn()) imp ffff937747e2e800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.142@tcp at head 00000100:00080000:0.0:1789265659.099929:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265659.099934:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265659.099938:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265659.099961:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789265659.100377:0:17880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789265659.100458:0:17880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789265659.100475:0:17880:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1789265659.110136:0:17149:0:(import.c:65:import_set_state_nolock()) ffff93777aaec800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265659.110831:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1876180579047424:12345-0@lo:38:llog_process_th.0 Request processed in 29261us (29466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.110844:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:3.0:1789265659.112069:0:17880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265659.115076:0:17880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789265659.115270:0:17880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789265659.117228:0:17887:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789265659.117235:0:17887:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1789265659.119672:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265659.119689:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789265659.119700:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789265659.119707:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789265659.119711:0:3642:0:(import.c:65:import_set_state_nolock()) ffff93777aaea000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789265659.119728:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579047424:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789265659.120076:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265659.120094:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579047680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265659.120174:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265659.120414:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579047680 00000100:00100000:1.0:1789265659.120422:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579047680 00000100:00100000:1.0:1789265659.120474:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265659.120495:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876180579047680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265659.120529:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789265659.120587:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876180579047680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265659.120594:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265659.120721:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579047680:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1789265659.121384:0:17880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789265659.121397:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789265659.121445:0:17880:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789265659.121468:0:17880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbbfdc9019c1d4ca6 00000100:00080000:3.0:1789265659.121476:0:17880:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265659.121482:0:17880:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff937747e2e800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265659.121507:0:17880:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9376434d6300 x1876180579047808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265659.121536:0:17880:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789265659.121580:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579047808:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789265659.121665:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265659.121671:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265659.121673:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265659.121676:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000400:00000100:0.0:1789265659.121712:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180579047808 offset 0 length 520: 4 00000020:01000000:3.0:1789265659.124120:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265659.124132:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.124134:0:17880:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789265659.124138:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265659.124143:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.124144:0:17880:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789265659.124158:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789265659.124160:0:17880:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789265659.124163:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265659.124166:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.124167:0:17880:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789265659.124169:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265659.124171:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.124172:0:17880:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789265659.124176:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789265659.124212:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265659.124216:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.124217:0:17880:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789265659.124221:0:17880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1789265659.125184:0:17876:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789265659.125229:0:17876:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789265659.125257:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d4c28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4c2f expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.125270:0:17876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fd000/0xbbfdc9019c1d4c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4c2f expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265659.125280:0:17876:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93775f5f4800 from 1 10000000:01000000:0.0:1789265659.125282:0:17876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265659.125324:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.125332:0:17876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.125344:0:17876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265659.125379:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579047936:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789265659.125451:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265659.125502:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377471939c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265659.126277:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579047936 00000100:00100000:3.0:1789265659.126287:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579047936 00000100:00100000:3.0:1789265659.126347:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789265659.126357:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+15:17876:x1876180579047936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265659.126372:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265659.126389:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377465a4a00/0xbbfdc9019c1d4cb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4cad expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.126415:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377465a4a00/0xbbfdc9019c1d4cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4cad expref: 16 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.126427:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377465a4a00/0xbbfdc9019c1d4cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4cad expref: 16 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.126452:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377465a4a00, rc 0) 00000100:00100000:3.0:1789265659.126507:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+16:17876:x1876180579047936:12345-0@lo:101:mount.lustre.0 Request processed in 152us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.126514:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789265659.126611:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579047936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265659.126628:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4cb4 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.126637:0:17876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4cb4 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265659.127230:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048064:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789265659.127278:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265659.127308:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377471939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265659.127326:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579048064 00000100:00100000:0.0:1789265659.127331:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579048064 00000100:00100000:0.0:1789265659.127369:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789265659.127376:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+16:17876:x1876180579048064:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789265659.127390:0:17137:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789265659.127447:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789265659.127451:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789265659.127555:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+16:17876:x1876180579048064:12345-0@lo:256:mount.lustre.0 Request processed in 178us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265659.127563:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265659.127602:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048064:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789265659.129273:0:17876:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789265659.129304:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4cb4 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.129329:0:17876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4cb4 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265659.135887:0:17876:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93775f5f4800 from 1 10000000:01000000:3.0:1789265659.135898:0:17876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265659.135970:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.135983:0:17876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.135996:0:17876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265659.136027:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265659.136099:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265659.136438:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579048192 00000100:00100000:2.0:1789265659.136447:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579048192 00000100:00100000:2.0:1789265659.136513:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265659.136524:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+16:17876:x1876180579048192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265659.136540:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265659.136556:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9376435fc000/0xbbfdc9019c1d4cc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4cbb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.136582:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fc000/0xbbfdc9019c1d4cc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4cbb expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.136607:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9376435fc000/0xbbfdc9019c1d4cc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4cbb expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.136617:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc000, rc 0) 00000100:00100000:2.0:1789265659.136660:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17876:x1876180579048192:12345-0@lo:101:mount.lustre.0 Request processed in 139us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.136666:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265659.137041:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265659.137065:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048192:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265659.137080:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4cc2 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.137090:0:17876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4cc2 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265659.137295:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265659.137330:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265659.137377:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.137399:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265659.137470:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579048320 00000100:00100000:0.0:1789265659.137475:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579048320 00000100:00100000:0.0:1789265659.137510:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265659.137524:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17876:x1876180579048320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265659.137630:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17876:x1876180579048320:12345-0@lo:501:mount.lustre.0 Request processed in 106us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265659.137637:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789265659.137768:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265659.137794:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048448:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265659.138112:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.138144:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.138334:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579048448 00000100:00100000:2.0:1789265659.138339:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579048448 00000100:00100000:2.0:1789265659.138380:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265659.138388:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17876:x1876180579048448:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265659.138491:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17876:x1876180579048448:12345-0@lo:503:mount.lustre.0 Request processed in 103us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.138506:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789265659.138661:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048448:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265659.139381:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265659.139468:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265659.139511:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.139643:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265659.144796:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579048576 00000100:00100000:0.0:1789265659.144972:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579048576 00000100:00100000:0.0:1789265659.145039:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789265659.145051:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17876:x1876180579048576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265659.145293:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17876:x1876180579048576:12345-0@lo:502:mount.lustre.0 Request processed in 244us (5779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265659.145301:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265659.145404:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265659.145716:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789265659.145745:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1789265659.145758:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1789265659.145769:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1789265659.145780:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1789265659.145791:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1789265659.145803:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1789265659.145828:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1789265659.145839:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789265659.145850:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1789265659.145906:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1789265659.145952:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265659.145996:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.146037:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.146172:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579048704 00000100:00100000:2.0:1789265659.146178:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579048704 00000100:00100000:2.0:1789265659.146218:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789265659.146226:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17876:x1876180579048704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265659.146316:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17876:x1876180579048704:12345-0@lo:502:mount.lustre.0 Request processed in 91us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.146324:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789265659.146509:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265659.146551:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1789265659.146558:0:17876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789265659.148619:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265659.148633:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.148636:0:17889:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789265659.148644:0:17889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93775f5f4800 00000020:00000080:3.0:1789265659.148647:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265659.148656:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265659.148658:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.148660:0:17889:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789265659.148662:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265659.148664:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.148666:0:17889:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789265659.148669:0:17889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93775f5f4800 00000020:00000080:3.0:1789265659.148670:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265659.149061:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265659.149067:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.149068:0:17889:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789265659.149071:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265659.149073:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.149074:0:17889:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265659.149078:0:17889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93775f5f4800 00000020:00000080:3.0:1789265659.149080:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265659.149550:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265659.149557:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.149559:0:17889:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265659.149562:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265659.149565:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.149566:0:17889:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789265659.149570:0:17889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93775f5f4800 00000020:00000080:3.0:1789265659.149572:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265659.149614:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265659.149617:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.149618:0:17889:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789265659.149621:0:17889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1789265659.156059:0:17876:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789265659.156110:0:17876:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265659.156134:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4cc2 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.156148:0:17876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4cc2 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265659.156316:0:17876:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789265659.156319:0:17876:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93775f5f4800 10000000:01000000:0.0:1789265659.156322:0:17876:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93775f5f4800 10000000:01000000:0.0:1789265659.156326:0:17876:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265659.156332:0:17876:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93775f5f4800 from 1 10000000:01000000:0.0:1789265659.156335:0:17876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789265659.156374:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393200/0xbbfdc9019c1d4cc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.156384:0:17876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642393200/0xbbfdc9019c1d4cc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.156402:0:17876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642393200/0xbbfdc9019c1d4cc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265659.156429:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789265659.157305:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265659.157399:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377435d79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265659.162376:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579048832 00000100:00100000:3.0:1789265659.162392:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579048832 00000100:00100000:2.0:1789265659.163992:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789265659.164009:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17876:x1876180579048832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265659.164031:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265659.164053:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9376435fd400/0xbbfdc9019c1d4cd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4cc9 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.164086:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fd400/0xbbfdc9019c1d4cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4cc9 expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.164098:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9376435fd400/0xbbfdc9019c1d4cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4cc9 expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.164109:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd400, rc 0) 00000100:00100000:2.0:1789265659.164471:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17876:x1876180579048832:12345-0@lo:101:mount.lustre.0 Request processed in 466us (7168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.164479:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789265659.164528:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265659.164547:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642393200/0xbbfdc9019c1d4cc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4cd0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.164568:0:17876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642393200/0xbbfdc9019c1d4cc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4cd0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265659.174696:0:17876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789265659.175998:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265659.176271:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789265659.176298:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1789265659.176313:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1789265659.176326:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1789265659.176340:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1789265659.176352:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1789265659.176365:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1789265659.176398:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1789265659.176414:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1789265659.176427:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1789265659.176441:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1789265659.176454:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1789265659.176468:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1789265659.176480:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1789265659.176494:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1789265659.176507:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1789265659.176518:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1789265659.176530:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1789265659.176542:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1789265659.176556:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1789265659.176569:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1789265659.176581:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1789265659.176599:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1789265659.176627:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1789265659.176642:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1789265659.176656:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1789265659.176668:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1789265659.176693:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1789265659.176714:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1789265659.176719:0:17876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789265659.178096:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f580380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265659.178178:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265659.178221:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.178246:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579048960 00000100:00100000:2.0:1789265659.178255:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579048960 00000100:00100000:2.0:1789265659.178309:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789265659.178318:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937745491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17876:x1876180579048960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265659.178456:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937745491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17876:x1876180579048960:12345-0@lo:501:mount.lustre.0 Request processed in 138us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.178463:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789265659.178590:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f580380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579048960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265659.178635:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579049088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265659.178677:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.178689:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.179930:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579049088 00000100:00100000:2.0:1789265659.179948:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579049088 00000100:00100000:2.0:1789265659.180004:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789265659.180014:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937745493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17876:x1876180579049088:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265659.180153:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937745493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17876:x1876180579049088:12345-0@lo:503:mount.lustre.0 Request processed in 141us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.180160:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789265659.180500:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579049088:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789265659.181027:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265659.181127:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579049216:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265659.181181:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265659.181228:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265659.181236:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579049216 00000100:00100000:3.0:1789265659.181242:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579049216 00000100:00100000:3.0:1789265659.181280:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265659.181289:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937745490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17876:x1876180579049216:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265659.181386:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937745490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17876:x1876180579049216:12345-0@lo:502:mount.lustre.0 Request processed in 98us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.181394:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789265659.182478:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579049216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265659.182744:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789265659.182770:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1789265659.182782:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1789265659.182793:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1789265659.182906:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1789265659.182924:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1789265659.182935:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1789265659.182961:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1789265659.182973:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1789265659.182985:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1789265659.183000:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1789265659.183031:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1789265659.183046:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1789265659.183058:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1789265659.183070:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1789265659.183082:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1789265659.183094:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1789265659.183107:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1789265659.183120:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1789265659.183134:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1789265659.183147:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1789265659.183160:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1789265659.183174:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1789265659.183186:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1789265659.183198:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1789265659.183211:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1789265659.183225:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1789265659.183247:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1789265659.183258:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1789265659.183267:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1789265659.183285:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1789265659.183295:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1789265659.183307:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1789265659.183318:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1789265659.183327:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1789265659.183337:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1789265659.183347:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1789265659.183356:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1789265659.183366:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1789265659.183375:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1789265659.183384:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1789265659.183395:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1789265659.183406:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1789265659.183429:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1789265659.183443:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1789265659.183456:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1789265659.183468:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1789265659.183480:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1789265659.183531:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579049344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265659.183600:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265659.183652:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377414f4300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265659.183661:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579049344 00000100:00100000:3.0:1789265659.183668:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579049344 00000100:00100000:3.0:1789265659.183716:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789265659.183725:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937745493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17876:x1876180579049344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265659.183836:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937745493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17876:x1876180579049344:12345-0@lo:502:mount.lustre.0 Request processed in 111us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.183844:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265659.184757:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579049344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265659.186101:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1789265659.186136:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1789265659.186178:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579049472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265659.186249:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265659.186290:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff937748102b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265659.186554:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579049472 00000100:00100000:0.0:1789265659.186564:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579049472 00000100:00100000:0.0:1789265659.186619:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265659.186629:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937745493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17876:x1876180579049472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265659.186750:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937745493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17876:x1876180579049472:12345-0@lo:502:mount.lustre.0 Request processed in 122us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265659.186757:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789265659.187981:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579049472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265659.188070:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1789265659.188089:0:17876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789265659.192570:0:17895:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789265659.192592:0:17895:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff93777a9819b8) 00000020:00000080:1.0:1789265659.192618:0:17895:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789265659.192735:0:17895:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93775f5f4800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789265659.192740:0:17895:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93775f5f4800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789265659.192743:0:17895:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93775f5f4800 3 00010000:00080000:1.0:1789265659.192777:0:17895:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93777f3f2000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1789265659.194749:0:17895:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1789265659.196199:0:17895:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789265659.196243:0:17895:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789265659.196255:0:17895:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xbbfdc9019c1d4cde 00000100:00080000:1.0:1789265659.196266:0:17895:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265659.196271:0:17895:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93777f3f2000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1789265659.196306:0:17895:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f159c00 x1876180579049600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265659.196336:0:17895:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789265659.196363:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265659.196368:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265659.196371:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265659.196374:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789265659.196517:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180579049600:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789265659.196589:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265659.197651:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579049600 00000100:00100000:1.0:1789265659.197662:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579049600 00000100:00100000:1.0:1789265659.197697:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265659.197705:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876180579049600:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789265659.197728:0:17143:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:1.0:1789265659.197773:0:17143:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xbbfdc9019c1d4ce5 00000004:00100000:1.0:1789265659.197795:0:17143:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789265659.197840:0:17143:0:(import.c:65:import_set_state_nolock()) ffff93775455f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265659.197938:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180579049600:12345-0@lo:38:llog_process_th.0 Request processed in 232us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265659.197955:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1789265659.198062:0:17895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00010000:00080000:0.0:1789265659.198239:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93774f159c00 x1876180579049600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265659.198250:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265659.198257:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789265659.198264:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789265659.198268:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789265659.198270:0:3642:0:(import.c:65:import_set_state_nolock()) ffff93777f3f2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789265659.198276:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180579049600:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1789265659.198306:0:17876:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789265659.198343:0:17876:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265659.198361:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393200/0xbbfdc9019c1d4cc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4cd0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.198371:0:17876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642393200/0xbbfdc9019c1d4cc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4cd0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789265659.198415:0:17876:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789265659.198417:0:17876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789265659.198419:0:17876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265659.198420:0:17876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265659.198421:0:17876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265659.198422:0:17876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265659.198424:0:17876:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265659.198425:0:17876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265659.198427:0:17876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265659.198431:0:17876:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1789265659.198434:0:17876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265659.198435:0:17876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789265659.198436:0:17876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265659.198437:0:17876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265659.198438:0:17876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265659.198439:0:17876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265659.198440:0:17876:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265659.198441:0:17876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265659.198442:0:17876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265659.198460:0:17876:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789265659.198476:0:17876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579049728:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789265659.198518:0:17876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265659.198544:0:17876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377461bbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265659.198776:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579049728 00000100:00100000:1.0:1789265659.198781:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579049728 00000100:00100000:1.0:1789265659.198820:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789265659.198828:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937745491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17876:x1876180579049728:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789265659.198848:0:17138:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789265659.198889:0:17138:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789265659.200978:0:17124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789265659.201258:0:17138:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789265659.201276:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789265659.202591:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789265659.202600:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789265659.202623:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.202654:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377465a5000/0xbbfdc9019c1d4bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4be9 expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.202662:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377465a4a00/0xbbfdc9019c1d4cb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4cad expref: 18 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.202670:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.202707:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377465a4a00/0xbbfdc9019c1d4cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d4cad expref: 18 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.202723:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9377465a4a00/0xbbfdc9019c1d4cb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cad expref: 18 pid: 17136 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265659.202738:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1876180579049856:0@lo:104: 00000100:00100000:0.0:1789265659.208985:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.209034:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579049856 00000100:00100000:3.0:1789265659.209052:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579049856 00010000:00010000:0.0:1789265659.209068:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377465a5000/0xbbfdc9019c1d4bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d4be9 expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.209082:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9377465a5000/0xbbfdc9019c1d4bf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4be9 expref: 18 pid: 17137 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265659.209096:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1876180579049984:0@lo:104: 00000100:00100000:3.0:1789265659.209103:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265659.209111:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+3:17159:x1876180579049856:12345-0@lo:104: 00010000:00010000:3.0:1789265659.209124:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4cb4 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265659.209127:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265659.209138:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377461bbcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1789265659.209186:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265659.209194:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+3:17159:x1876180579049856:12345-0@lo:104: Request processed in 83us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.209201:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265659.209216:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579049984 00000100:00100000:3.0:1789265659.209219:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579049984 00000100:00100000:3.0:1789265659.209232:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265659.209237:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+3:17159:x1876180579049984:12345-0@lo:104: 00010000:00010000:3.0:1789265659.209244:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4bf0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.209273:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789265659.209278:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+3:17159:x1876180579049984:12345-0@lo:104: Request processed in 41us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.209283:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789265659.209302:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265659.209308:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4cb4 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.209314:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393c00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:3.0:1789265659.209318:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d4cb4 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.209336:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d4cb4 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265659.209343:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d4cb4 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265659.209350:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265659.209381:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4cb4 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.209387:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265659.209407:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4cb4 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.209413:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937642393c00/0xbbfdc9019c1d4cad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4cb4 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.209423:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265659.209426:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4bf0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.209432:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bcc00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:3.0:1789265659.209435:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d4bf0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.209441:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d4bf0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265659.209447:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d4bf0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265659.209459:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789265659.209473:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4bf0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.209477:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265659.209489:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4bf0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.209495:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bcc00/0xbbfdc9019c1d4be9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4bf0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.209507:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265659.209509:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265659.209510:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265659.209528:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3644:1876180579050112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265659.209555:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.209584:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579050240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265659.209604:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265659.209709:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937745491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17876:x1876180579049728:12345-0@lo:253:mount.lustre.0 Request processed in 10881us (11189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265659.209718:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:0.0:1789265659.209751:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265659.209777:0:17876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17876:1876180579049728:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789265659.209787:0:17876:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789265659.209790:0:17876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265659.209792:0:17876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789265659.209793:0:17876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265659.209794:0:17876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265659.209795:0:17876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265659.209797:0:17876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265659.209798:0:17876:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265659.209799:0:17876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265659.209800:0:17876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789265659.209829:0:17876:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789265659.213660:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579050112 00000100:00100000:3.0:1789265659.213674:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579050112 00010000:00010000:3.0:1789265659.213708:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377465a4a00/0xbbfdc9019c1d4cb4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cad expref: 18 pid: 17136 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265659.213746:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579050240 00000100:00100000:3.0:1789265659.213749:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579050240 00010000:00010000:3.0:1789265659.213762:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377465a5000/0xbbfdc9019c1d4bf0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4be9 expref: 19 pid: 17137 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265659.213778:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265659.213798:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:3644:x1876180579050112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265659.213902:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789265659.213903:0:17131:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1789265659.213908:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377465a4a00/0xbbfdc9019c1d4cb4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cad expref: 19 pid: 17136 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265659.213911:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789265659.213920:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377465a4a00/0xbbfdc9019c1d4cb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cad expref: 19 pid: 17136 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.214014:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265659.214026:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265659.214033:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:3645:x1876180579050240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265659.214040:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265659.214044:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377465a5000/0xbbfdc9019c1d4bf0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4be9 expref: 19 pid: 17137 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.214053:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377465a5000/0xbbfdc9019c1d4bf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4be9 expref: 19 pid: 17137 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.214065:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265659.214069:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:3644:x1876180579050112:12345-0@lo:103:ldlm_bl.0 Request processed in 274us (4513us total) trans 0 rc 0/0 00010000:00010000:0.0:1789265659.214074:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265659.214076:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 20000000:01000000:0.0:1789265659.214088:0:17131:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012514975s 00010000:00010000:0.0:1789265659.214093:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.214100:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.214106:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.214113:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.214119:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265659.214122:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265659.214131:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3644:1876180579050112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265659.214139:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.214148:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.214158:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265659.214189:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:3645:x1876180579050240:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (4584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265659.214195:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265659.214228:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579050240:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265659.214255:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377465a4a00/0xbbfdc9019c1d4cb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cad expref: 17 pid: 17136 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265659.214267:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1876180579049856:0@lo:104: 00010000:00010000:3.0:1789265659.214279:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377465a5000/0xbbfdc9019c1d4bf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d4be9 expref: 16 pid: 17137 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265659.214287:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1876180579049984:0@lo:104: 00010000:00010000:3.0:1789265659.214309:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.214318:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.214334:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.214340:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4cec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1789265659.218557:0:17876:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1789265659.218771:0:17902:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1789265659.219257:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1789265659.222050:0:17901:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789265659.222057:0:17901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:3.0:1789265659.222284:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789265659.222359:0:17902:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1789265659.222532:0:17876:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1789265659.223255:0:17903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1876180579050368:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789265659.223329:0:17903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.223370:0:17903:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.223423:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579050368 00000100:00100000:2.0:1789265659.223431:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579050368 00000100:00100000:2.0:1789265659.223485:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265659.223495:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1876180579050368:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789265659.223588:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1876180579050368:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 94us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.223596:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265659.223695:0:17903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1876180579050368:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1789265659.223728:0:17903:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789265659.223752:0:17903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1876180579050496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789265659.223781:0:17903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.223812:0:17903:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.224058:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579050496 00000100:00100000:2.0:1789265659.224062:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579050496 00000100:00100000:2.0:1789265659.224091:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265659.224097:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1876180579050496:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789265659.224198:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1876180579050496:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 101us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.224204:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265659.224277:0:17903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1876180579050496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789265659.224326:0:17903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17903:1876180579050624:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789265659.224355:0:17903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.224378:0:17903:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265659.224433:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579050624 00000100:00100000:0.0:1789265659.224440:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579050624 00000100:00100000:0.0:1789265659.224477:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265659.224485:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1876180579050624:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789265659.224535:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1876180579050624:12345-0@lo:900:lod0001_rec0000.0 Request processed in 51us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265659.224542:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789265659.224596:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9376434d4a80 x1876180579050624/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265675 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265659.224607:0:17903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17903:1876180579050624:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789265659.224652:0:17903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1876180579050752:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789265659.224681:0:17903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.224705:0:17903:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265659.224741:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579050752 00000100:00100000:0.0:1789265659.224745:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579050752 00000100:00100000:0.0:1789265659.224768:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265659.224775:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1876180579050752:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789265659.224856:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1876180579050752:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 81us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265659.224884:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265659.225067:0:17903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1876180579050752:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1789265659.225106:0:17903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265659.227479:0:17903:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789265659.227557:0:17903:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789265659.227561:0:17903:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:01000000:1.0:1789265659.227911:0:17876:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789265659.228101:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789265659.228539:0:17876:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789265659.228547:0:17876:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789265659.228583:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265659.229672:0:17876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789265659.230585:0:17876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789265659.230624:0:17876:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789265659.230781:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789265659.231610:0:17876:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:1.0:1789265659.233663:0:17876:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789265659.246771:0:17876:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789265659.247135:0:17876:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa6058148b988 00100000:10000000:1.0:1789265659.247144:0:17876:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789265659.248357:0:17876:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789265659.248390:0:17876:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789265659.248408:0:17876:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789265659.248436:0:17876:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789265659.249311:0:17876:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265659.249525:0:17876:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789265659.571037:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265659.890966:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00000040:00080000:2.0:1789265660.214381:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789265660.595580:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265660.929349:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 10000000:01000000:0.0:1789265661.112721:0:17141:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265661.112733:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93775f5f4800 from 8 10000000:01000000:0.0:1789265661.112739:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265661.113077:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265661.113091:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265661.113106:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265661.113134:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579050880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265661.113216:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265661.113403:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579050880 00000100:00100000:1.0:1789265661.113412:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579050880 00000100:00100000:0.0:1789265661.113439:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377461bb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265661.113484:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789265661.113495:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+16:17141:x1876180579050880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265661.113510:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265661.113525:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4cfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4cf3 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265661.113551:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4cf3 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265661.113563:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4cf3 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265661.113572:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc800, rc 0) 00000100:00100000:1.0:1789265661.113621:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17141:x1876180579050880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265661.113635:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789265661.113657:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579050880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265661.113675:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4cfa expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265661.113684:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4cfa expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265661.113733:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579051008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789265661.113909:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265661.113937:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377461bb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265661.114766:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579051008 00000100:00100000:1.0:1789265661.114773:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579051008 00000100:00100000:1.0:1789265661.114815:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789265661.114823:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17141:x1876180579051008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789265661.114841:0:17138:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789265661.114882:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789265661.114886:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789265661.115009:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17141:x1876180579051008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 186us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265661.115018:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789265661.115037:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579051008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789265661.115088:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265661.115099:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4cfa expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265661.115108:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4cfa expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265661.115117:0:17141:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265661.115119:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93777f58d800 from 8 10000000:01000000:0.0:1789265661.115122:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265661.115142:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265661.115149:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265661.115157:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265661.115173:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579051136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265661.115200:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265661.115230:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377461bb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265661.116493:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579051136 00000100:00100000:1.0:1789265661.116503:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579051136 00000100:00100000:1.0:1789265661.116546:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265661.116556:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17141:x1876180579051136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265661.116568:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265661.116583:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bd000/0xbbfdc9019c1d4d08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4d01 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265661.116609:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bd000/0xbbfdc9019c1d4d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d01 expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265661.116622:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bd000/0xbbfdc9019c1d4d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d01 expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265661.116631:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd000, rc 0) 00000100:00100000:1.0:1789265661.116689:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17141:x1876180579051136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265661.116708:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789265661.116726:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579051136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265661.116879:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d08 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265661.116891:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4d08 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265661.116957:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579051264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789265661.116992:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265661.117014:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377461bb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789265661.117065:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579051264 00000100:00100000:1.0:1789265661.117071:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579051264 00000100:00100000:1.0:1789265661.117102:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789265661.117111:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17141:x1876180579051264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789265661.117125:0:17138:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789265661.117142:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789265661.117145:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789265661.117229:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17141:x1876180579051264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265661.117237:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789265661.117248:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579051264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789265661.117303:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265661.117309:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d08 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265661.117316:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d08 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265661.236130:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265661.619566:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265661.945607:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00010000:00010000:1.0:1789265662.646346:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265662.963055:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00010000:00010000:3.0:1789265663.669878:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265663.993038:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 0 seconds 00000001:02000400:3.0:1789265663.998309:0:18145:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789265664.500136:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579051392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265664.500233:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265664.500386:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579051392 00000100:00100000:1.0:1789265664.500393:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579051392 00000100:00100000:1.0:1789265664.500441:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265664.500450:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579051392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265664.500484:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789265664.500545:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579051392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265664.500553:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265664.500602:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579051392:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789265664.500907:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789265664.500912:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789265664.500916:0:8:0:(import.c:65:import_set_state_nolock()) ffff937779e22800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265664.500921:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:3.0:1789265664.500924:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789265664.500928:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff937779e22800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265664.500950:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9376434d5f80 x1876180579051648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265664.500968:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265664.500972:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265664.500975:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265664.500989:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265664.501003:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265664.501007:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265664.501009:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265664.501013:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789265664.501044:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579051904:0@lo:400:kworker.0 00000100:00100000:3.0:1789265664.501082:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265664.501117:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579051648:0@lo:38:kworker.0 00000100:00100000:0.0:1789265664.501232:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579051520:0@lo:400:kworker.0 00000100:00100000:0.0:1789265664.501266:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265664.501291:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265664.501297:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579051776:0@lo:400:kworker.0 00000100:00100000:0.0:1789265664.501318:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265664.501441:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579051520 00000100:00100000:1.0:1789265664.501446:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579051520 00000100:00100000:1.0:1789265664.501488:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789265664.501503:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:3643:x1876180579051520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265664.501552:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:3643:x1876180579051520:12345-0@lo:400:kworker.0 Request processed in 49us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265664.501559:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789265664.501585:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579051904 00000100:00100000:1.0:1789265664.501588:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579051904 00000100:00100000:1.0:1789265664.501609:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579051776 00000100:00100000:1.0:1789265664.501611:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579051776 00000100:00100000:1.0:1789265664.501621:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265664.501626:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579051904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265664.501656:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579051904:12345-0@lo:400:kworker.0 Request processed in 29us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265664.501661:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265664.501670:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265664.501675:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579051776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265664.501695:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579051776:12345-0@lo:400:kworker.0 Request processed in 20us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265664.501700:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789265664.501728:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9376434d4700 x1876180579051904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265664.501740:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579051904:0@lo:400:kworker.0 00010000:00080000:1.0:1789265664.501762:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9376434d5500 x1876180579051776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265664.501770:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579051776:0@lo:400:kworker.0 00000100:00100000:1.0:1789265664.501778:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579051520:0@lo:400:kworker.0 00000100:00100000:3.0:1789265664.501930:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265664.502053:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579051648 00000100:00100000:1.0:1789265664.502058:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579051648 00000100:00100000:1.0:1789265664.502084:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265664.502089:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876180579051648:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789265664.502117:0:17148:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:1.0:1789265664.502165:0:17148:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbbfdc9019c1d4d0f 00000004:00100000:1.0:1789265664.502182:0:17148:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789265664.502188:0:17148:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789265664.513254:0:17148:0:(import.c:65:import_set_state_nolock()) ffff937643354000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265664.513357:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180579051648:12345-0@lo:38:kworker.0 Request processed in 11264us (11424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265664.513368:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265664.513609:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265664.513619:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789265664.513626:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789265664.513631:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789265664.513633:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937779e22800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789265664.513650:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008de80f9f): req@ffff93777f582a00 x1876180579044480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265664.513682:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579051648:0@lo:38:kworker.0 00000100:00100000:0.0:1789265664.513827:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579052032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265664.513906:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265664.513942:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579052032 00000100:00100000:0.0:1789265664.513949:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579052032 00000100:00100000:0.0:1789265664.513984:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265664.513993:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876180579052032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265664.514022:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789265664.514060:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876180579052032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265664.514067:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265664.514093:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579052032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265664.514412:0:17185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265664.514436:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e7f6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265664.514451:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579044480 00000100:00100000:1.0:1789265664.514455:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579044480 00000100:00100000:1.0:1789265664.514473:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265664.514478:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17185:x1876180579044480:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789265664.514651:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17185:x1876180579044480:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 172us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265664.514658:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789265664.514711:0:17185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1876180579044480:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1789265664.514742:0:17185:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789265664.514777:0:17185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1876180579052160:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789265664.514808:0:17185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265664.514835:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377461bbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265664.515011:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579052160 00000100:00100000:1.0:1789265664.515016:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579052160 00000100:00100000:1.0:1789265664.515039:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265664.515045:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17185:x1876180579052160:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789265664.515365:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17185:x1876180579052160:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 320us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265664.515381:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265664.515433:0:17185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1876180579052160:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789265664.515588:0:17185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1876180579052288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789265664.515616:0:17185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265664.515641:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265664.515687:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579052288 00000100:00100000:0.0:1789265664.515692:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579052288 00000100:00100000:0.0:1789265664.515720:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265664.515727:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17185:x1876180579052288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789265664.515786:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17185:x1876180579052288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 59us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265664.515793:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265664.515912:0:17185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1876180579052288:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789265664.515955:0:17185:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265664.521710:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789265664.521787:0:17185:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:2.0:1789265664.521793:0:17185:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789265664.691062:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789265664.749755:0:18197:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265664.750452:0:18197:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1789265665.585685:0:18248:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265665.585954:0:18248:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789265665.715028:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265665.972374:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1789265666.553316:0:18297:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffe74d520 20000000:00000080:3.0:1789265666.553333:0:18297:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff937781c46c00 uarg=0000000000000000 20000000:01000000:3.0:1789265666.553372:0:18297:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789265666.553380:0:18297:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789265666.553385:0:18297:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789265666.559673:0:18298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1789265666.560672:0:18297:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789265666.572090:0:18297:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789265666.572189:0:18297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265666.572209:0:18297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377465a5200/0xbbfdc9019c1d4bbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4bb8 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265666.572234:0:18297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9376435fc000/0xbbfdc9019c1d4cc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4cbb expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265666.572241:0:18297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265666.572285:0:18297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9376435fc000/0xbbfdc9019c1d4cc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d4cbb expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265666.572300:0:18297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9376435fc000/0xbbfdc9019c1d4cc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cbb expref: 17 pid: 17138 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265666.572315:0:18297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1876180579052416:0@lo:104: 00000100:00100000:2.0:1789265666.572385:0:18297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265666.572494:0:18297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377465a5200/0xbbfdc9019c1d4bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d4bb8 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265666.572503:0:18297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9377465a5200/0xbbfdc9019c1d4bbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4bb8 expref: 17 pid: 17137 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265666.573234:0:18297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1876180579052544:0@lo:104: 00000100:00100000:2.0:1789265666.573269:0:18297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265666.573887:0:18297:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265666.574180:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579052416 00000100:00100000:3.0:1789265666.574189:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579052416 00000100:00100000:3.0:1789265666.574230:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579052544 00000100:00100000:3.0:1789265666.574232:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579052544 00000100:00100000:3.0:1789265666.574247:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265666.574255:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+4:18297:x1876180579052416:12345-0@lo:104: 00010000:00010000:3.0:1789265666.574270:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4cc2 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.574350:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265666.574357:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+4:18297:x1876180579052416:12345-0@lo:104: Request processed in 102us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265666.574364:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265666.574382:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265666.574388:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+3:18297:x1876180579052544:12345-0@lo:104: 00010000:00010000:3.0:1789265666.574396:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4bbf expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.574429:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789265666.574434:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+3:18297:x1876180579052544:12345-0@lo:104: Request processed in 46us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265666.574440:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789265666.574467:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265666.574472:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4cc2 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.574480:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5600 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:3.0:1789265666.574484:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d4cc2 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.574492:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d4cc2 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265666.574499:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d4cc2 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265666.574505:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789265666.577750:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4cc2 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.577762:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265666.577787:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4cc2 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.577976:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377465a5600/0xbbfdc9019c1d4cbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4cc2 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.578000:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265666.578006:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4bbf expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.578013:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fc200 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:3.0:1789265666.578017:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d4bbf expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.578026:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d4bbf expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265666.578033:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d4bbf expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265666.578039:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789265666.578055:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4bbf expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.578061:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265666.578068:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4bbf expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.578088:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9376435fc200/0xbbfdc9019c1d4bb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4bbf expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.580733:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265666.580740:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265666.580742:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265666.580974:0:18297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1876180579052416:0@lo:104: 00000100:00100000:2.0:1789265666.580988:0:18297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1876180579052544:0@lo:104: 00010000:00010000:2.0:1789265666.581015:0:18297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265666.581621:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265666.581643:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579052672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265666.581711:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265666.581768:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265666.581776:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579052800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265666.581808:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265666.582211:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579052672 00000100:00100000:3.0:1789265666.582219:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579052672 00010000:00010000:3.0:1789265666.582255:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9376435fc000/0xbbfdc9019c1d4cc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cbb expref: 18 pid: 17138 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265666.582282:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579052800 00000100:00100000:3.0:1789265666.582285:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579052800 00010000:00010000:3.0:1789265666.582298:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377465a5200/0xbbfdc9019c1d4bbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4bb8 expref: 19 pid: 17137 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265666.582319:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265666.582327:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:3643:x1876180579052672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265666.582343:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265666.582348:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9376435fc000/0xbbfdc9019c1d4cc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cbb expref: 19 pid: 17138 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.582360:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9376435fc000/0xbbfdc9019c1d4cc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cbb expref: 19 pid: 17138 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.582379:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9376435fc000/0xbbfdc9019c1d4cc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cbb expref: 19 pid: 17138 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.582394:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265666.582445:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:3643:x1876180579052672:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265666.582453:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265666.582472:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265666.582479:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:3643:x1876180579052800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265666.582501:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265666.582506:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377465a5200/0xbbfdc9019c1d4bbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4bb8 expref: 17 pid: 17137 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265666.583250:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579052672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265666.584020:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377465a5200/0xbbfdc9019c1d4bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4bb8 expref: 17 pid: 17137 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.584039:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377465a5200/0xbbfdc9019c1d4bbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d4bb8 expref: 17 pid: 17137 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.584058:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.584067:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.584088:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.584165:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.584173:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.584179:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.584196:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fda00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265666.584202:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.584211:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.584228:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.584241:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265666.584304:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+16:3643:x1876180579052800:12345-0@lo:103:ldlm_bl.0 Request processed in 1824us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265666.584313:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265666.585388:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579052800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265666.585427:0:18297:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265666.585438:0:18297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265666.585444:0:18297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9376435fda00/0xbbfdc9019c1d4d16 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265666.739816:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265667.765573:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265667.954998:0:17141:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265667.955008:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93775f5f4800 from 13 10000000:01000000:2.0:1789265667.955015:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265667.955073:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265667.955096:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265667.955108:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265667.955137:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579052928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265667.955205:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265667.955254:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265667.955351:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579052928 00000100:00100000:1.0:1789265667.955359:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579052928 00000100:00100000:1.0:1789265667.955417:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789265667.955426:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+16:17141:x1876180579052928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265667.955441:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265667.955455:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d4d24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4d1d expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265667.955478:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d4d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d1d expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265667.955496:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d4d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d1d expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265667.955505:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bcc00, rc 0) 00000100:00100000:1.0:1789265667.955551:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17141:x1876180579052928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265667.955558:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789265667.955845:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579052928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265667.955893:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d24 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265667.955904:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4d24 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265667.955976:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579053056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265667.956007:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265667.956038:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377465b2780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265667.958126:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579053056 00000100:00100000:2.0:1789265667.958140:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579053056 00000100:00100000:2.0:1789265667.958196:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789265667.958206:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17141:x1876180579053056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265667.958369:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17141:x1876180579053056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (2361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265667.958377:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789265667.960165:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579053056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265667.960232:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579053184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265667.960310:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265667.960357:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377465b2780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265667.962261:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579053184 00000100:00100000:2.0:1789265667.962275:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579053184 00000100:00100000:2.0:1789265667.962331:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265667.962341:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17141:x1876180579053184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265667.962516:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17141:x1876180579053184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265667.962531:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789265667.962644:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579053184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789265667.963498:0:18358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789265667.966004:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789265667.966042:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265667.966053:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d24 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265667.966066:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d24 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265667.966076:0:17141:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789265667.966079:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93777f58d800 from 13 10000000:01000000:3.0:1789265667.966081:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265667.966119:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265667.966127:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265667.966150:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265667.966182:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579053312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265667.966257:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265667.966315:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff93777a3f9000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265667.970198:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579053312 00000100:00100000:2.0:1789265667.970215:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579053312 00000100:00100000:2.0:1789265667.970292:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789265667.970303:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+17:17141:x1876180579053312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265667.970321:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265667.970340:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d4d32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4d2b expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265667.970370:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d4d32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d2b expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265667.970382:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d4d32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d2b expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265667.970391:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fd200, rc 0) 00000100:00100000:2.0:1789265667.970479:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17141:x1876180579053312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (4220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265667.970485:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789265667.971002:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579053312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265667.971022:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d32 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265667.971033:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4d32 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265667.971120:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579053440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265667.971159:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265667.971197:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579053440 00000100:00100000:1.0:1789265667.971202:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579053440 00000100:00100000:0.0:1789265667.971209:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff937758111240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265667.971235:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265667.971247:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17141:x1876180579053440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265667.971367:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17141:x1876180579053440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265667.979973:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789265667.980026:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579053440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265667.980125:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579053568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265667.980193:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265667.980252:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff937758111240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265667.984066:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579053568 00000100:00100000:2.0:1789265667.984094:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579053568 00000100:00100000:2.0:1789265667.984167:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789265667.984177:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17141:x1876180579053568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265667.984350:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:17141:x1876180579053568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (4156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265667.984359:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265667.989038:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579053568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789265667.992453:0:18359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789265667.992609:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789265667.992637:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265667.992649:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d32 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265667.992662:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d32 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265668.596983:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265653/real 1789265653] req@ffff93774f15b100 x1876180579045632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265668 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265668.597017:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93774f15b100 x1876180579045632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265668 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265668.597028:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265653/real 1789265653] req@ffff93774f158000 x1876180579045760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265668 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265668.597041:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93774f158000 x1876180579045760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265668 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789265668.597062:0:3642:0:(import.c:65:import_set_state_nolock()) ffff93775dcee800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265668.597095:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789265668.597100:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579045632:0@lo:8:kworker.0 00000100:00080000:0.0:1789265668.597105:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937760304800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265668.597110:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789265668.597113:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579045760:0@lo:8:kworker.0 00000100:00080000:0.0:1789265668.597190:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265668.597194:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789265668.597196:0:38:0:(import.c:65:import_set_state_nolock()) ffff93775dcee800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265668.597200:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 509 00000100:00080000:0.0:1789265668.597212:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789265668.597219:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93775dcee800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265668.597239:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37e680 x1876180579053952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265668.597252:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265668.597255:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789265668.597257:0:38:0:(import.c:65:import_set_state_nolock()) ffff937760304800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265668.597261:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 509 00000100:00080000:0.0:1789265668.597263:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789265668.597267:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff937760304800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265668.597278:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f37f100 x1876180579054080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265668.597309:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265668.597313:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265668.597315:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265668.597318:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789265668.597345:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579053696:0@lo:400:kworker.0 00000100:00100000:0.0:1789265668.597419:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265668.597458:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579054464:0@lo:400:kworker.0 00000100:00100000:0.0:1789265668.597482:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265668.597504:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265668.597509:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579053824:0@lo:400:kworker.0 00000100:00100000:0.0:1789265668.597532:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265668.597571:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579054208:0@lo:400:kworker.0 00000100:00100000:0.0:1789265668.597596:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265668.597613:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265668.597619:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579054336:0@lo:400:kworker.0 00000100:00100000:0.0:1789265668.597638:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265668.597669:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579053696 00000100:00100000:0.0:1789265668.597676:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579053696 00000100:00100000:0.0:1789265668.597723:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265668.597734:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:3645:x1876180579053696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265668.597971:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579053824 00000100:00100000:1.0:1789265668.597976:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579053824 00000100:00100000:1.0:1789265668.597999:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579054336 00000100:00100000:1.0:1789265668.598002:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579054336 00000100:00100000:1.0:1789265668.598016:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789265668.598023:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876180579053824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265668.598070:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876180579053824:12345-0@lo:400:kworker.0 Request processed in 47us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265668.598090:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789265668.598107:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265668.598120:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579054336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265668.598151:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579054336:12345-0@lo:400:kworker.0 Request processed in 32us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265668.598157:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265668.598173:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579054464 00000100:00100000:1.0:1789265668.598176:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579054464 00000100:00100000:1.0:1789265668.598198:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579054208 00000100:00100000:1.0:1789265668.598200:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579054208 00000100:00100000:1.0:1789265668.598210:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265668.598215:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579054464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265668.598241:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579054464:12345-0@lo:400:kworker.0 Request processed in 26us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265668.598247:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265668.598258:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265668.598264:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579054208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265668.598288:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579054208:12345-0@lo:400:kworker.0 Request processed in 25us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265668.598294:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265668.598326:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579054336:0@lo:400:kworker.0 00010000:00080000:1.0:1789265668.598338:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93774e40f100 x1876180579054208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265668.598346:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579054208:0@lo:400:kworker.0 00000100:00100000:1.0:1789265668.598371:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579053952:0@lo:8:kworker.0 00000400:00000100:1.0:1789265668.598390:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180579053952 offset 0 length 520: 4 00000100:00100000:1.0:1789265668.598402:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579054080:0@lo:8:kworker.0 00000400:00000100:1.0:1789265668.598422:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180579054080 offset 0 length 520: 4 00000100:00100000:1.0:1789265668.598480:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579053824:0@lo:400:kworker.0 00010000:00080000:1.0:1789265668.598491:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93774e40e680 x1876180579054464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265668.598499:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579054464:0@lo:400:kworker.0 00000100:00100000:1.0:1789265668.599359:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:3645:x1876180579053696:12345-0@lo:400:kworker.0 Request processed in 1621us (1934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265668.599368:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265668.599921:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579053696:0@lo:400:kworker.0 00010000:00010000:3.0:1789265668.787011:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265669.620128:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579054592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265669.620201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265669.620359:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579054592 00000100:00100000:1.0:1789265669.620368:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579054592 00000100:00100000:1.0:1789265669.620414:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265669.620423:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876180579054592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265669.620456:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789265669.620505:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876180579054592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265669.620513:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265669.620543:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265659/real 1789265659] req@ffff9376434d6300 x1876180579047808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265669 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265669.620563:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9376434d6300 x1876180579047808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265669 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265669.620574:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265659/real 1789265659] req@ffff9376434d4e00 x1876180579047552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265669 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265669.620586:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9376434d4e00 x1876180579047552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265669 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789265669.620615:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937747e2e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265669.620631:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789265669.620636:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579047808:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789265669.620642:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376424d5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265669.620647:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789265669.620650:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579047552:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789265669.620703:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579054592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265669.620792:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265669.620802:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579054720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265669.620836:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265669.621239:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579054720 00000100:00100000:1.0:1789265669.621246:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579054720 00000100:00100000:1.0:1789265669.621289:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265669.621296:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579054720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265669.621318:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789265669.621362:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579054720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265669.621370:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265669.621404:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579054720:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789265669.628004:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265669.628021:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265669.628025:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265669.628028:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265669.628054:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265669.628058:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789265669.628062:0:8:0:(import.c:65:import_set_state_nolock()) ffff9376424d5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265669.628072:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1789265669.628077:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789265669.628085:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9376424d5000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1789265669.628110:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93777f582a00 x1876180579055104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265669.628128:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265669.628131:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789265669.628132:0:8:0:(import.c:65:import_set_state_nolock()) ffff937747e2e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265669.628135:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1789265669.628137:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789265669.628140:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff937747e2e800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1789265669.628151:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93777f583100 x1876180579055232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265669.628187:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579054976:0@lo:400:kworker.0 00000100:00100000:2.0:1789265669.628255:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265669.628290:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265669.628297:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579055360:0@lo:400:kworker.0 00000100:00100000:2.0:1789265669.628324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265669.628354:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265669.628363:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579054848:0@lo:400:kworker.0 00000100:00100000:2.0:1789265669.628395:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265669.628436:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579054848 00000100:00100000:2.0:1789265669.628443:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579054848 00000100:00100000:2.0:1789265669.628488:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789265669.628498:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:3643:x1876180579054848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265669.628547:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:3643:x1876180579054848:12345-0@lo:400:kworker.0 Request processed in 50us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265669.628554:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789265669.628609:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579054848:0@lo:400:kworker.0 00000100:00100000:2.0:1789265669.628630:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579055104:0@lo:8:kworker.0 00000400:00000100:2.0:1789265669.628653:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180579055104 offset 0 length 520: 4 00000100:00100000:2.0:1789265669.628677:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579055232:0@lo:8:kworker.0 00000400:00000100:2.0:1789265669.628697:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180579055232 offset 0 length 520: 4 00000100:00100000:1.0:1789265669.628947:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579054976 00000100:00100000:1.0:1789265669.628952:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579054976 00000100:00100000:1.0:1789265669.628986:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579055360 00000100:00100000:1.0:1789265669.628989:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579055360 00000100:00100000:1.0:1789265669.629004:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265669.629010:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579054976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265669.629054:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579054976:12345-0@lo:400:kworker.0 Request processed in 42us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265669.629070:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265669.629084:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265669.629090:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579055360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265669.629119:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579055360:12345-0@lo:400:kworker.0 Request processed in 30us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265669.629125:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789265669.629364:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93777f580380 x1876180579055360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265669.629376:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579055360:0@lo:400:kworker.0 00010000:00080000:2.0:1789265669.629388:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93777f583480 x1876180579054976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265669.629397:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579054976:0@lo:400:kworker.0 00010000:00010000:0.0:1789265669.820763:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789265670.139250:0:17877:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789265670.837122:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265671.478028:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789265671.862157:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265672.882980:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265673.915733:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789265674.728754:0:18645:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789265674.728759:0:18645:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789265674.728761:0:18645:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789265674.729434:0:18645:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93776128f000 00000020:01000004:0.0:1789265674.729458:0:18645:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789265674.729477:0:18645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789265674.729497:0:18645:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9376433a99b8) 00000020:00000080:0.0:1789265674.729518:0:18645:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00000100:00080000:1.0:1789265674.739238:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265674.739248:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265674.739252:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265674.739255:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265674.739270:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265674.739274:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265674.739277:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265674.739280:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789265674.739398:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579055744:0@lo:400:kworker.0 00000100:00100000:2.0:1789265674.739503:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265674.739602:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579056256:0@lo:400:kworker.0 00000100:00100000:2.0:1789265674.739638:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265674.739671:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265674.739677:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579055872:0@lo:400:kworker.0 00000100:00100000:2.0:1789265674.739708:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265674.739759:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579056256 00000100:00100000:2.0:1789265674.739769:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579056256 00000100:00100000:2.0:1789265674.739844:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265674.739856:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579056256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265674.739943:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579056256:12345-0@lo:400:kworker.0 Request processed in 89us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265674.739952:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265674.739979:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579055872 00000100:00100000:2.0:1789265674.739983:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579055872 00000100:00100000:2.0:1789265674.740013:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265674.740020:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579055872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265674.740051:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579055872:12345-0@lo:400:kworker.0 Request processed in 33us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265674.740058:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789265674.740106:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579055872:0@lo:400:kworker.0 00010000:00080000:2.0:1789265674.740121:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93774f158a80 x1876180579056256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265674.740133:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579056256:0@lo:400:kworker.0 00000100:00100000:3.0:1789265674.740203:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579055488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265674.740239:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265674.740274:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579056000:0@lo:400:kworker.0 00000100:00100000:3.0:1789265674.740298:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265674.740330:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789265674.740336:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579055616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265674.740358:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265674.740375:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579056128:0@lo:400:kworker.0 00000100:00100000:3.0:1789265674.740406:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265674.740434:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579056000 00000100:00100000:3.0:1789265674.740438:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579056000 00000100:00100000:3.0:1789265674.740470:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265674.740476:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579056000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265674.740512:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579056000:12345-0@lo:400:kworker.0 Request processed in 36us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265674.740518:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265674.740541:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579055488 00000100:00100000:3.0:1789265674.740545:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579055488 00000100:00100000:3.0:1789265674.740558:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579055616 00000100:00100000:3.0:1789265674.740560:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579055616 00000100:00100000:3.0:1789265674.740569:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579056128 00000100:00100000:3.0:1789265674.740571:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579056128 00000100:00100000:3.0:1789265674.740581:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265674.740586:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1876180579055488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265674.740617:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789265674.740661:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1876180579055488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265674.740667:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265674.740678:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265674.740682:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579055616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265674.740699:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265674.740725:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579055616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 42us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265674.740731:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265674.740742:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265674.740756:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579056128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265674.740784:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579056128:12345-0@lo:400:kworker.0 Request processed in 29us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265674.740790:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265674.740835:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579055616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265674.740846:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579056128:0@lo:400:kworker.0 00000100:00100000:3.0:1789265674.740856:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579055488:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1789265674.740903:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93774f15aa00 x1876180579056000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265674.740912:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579056000:0@lo:400:kworker.0 00000100:00100000:1.0:1789265674.741299:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579055744 00000100:00100000:1.0:1789265674.741305:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579055744 00000100:00100000:1.0:1789265674.741341:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789265674.741349:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:3645:x1876180579055744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265674.741407:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:3645:x1876180579055744:12345-0@lo:400:kworker.0 Request processed in 58us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265674.741414:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789265674.741470:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579055744:0@lo:400:kworker.0 00100000:10000000:3.0:1789265674.846440:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789265674.860722:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789265674.863007:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789265674.867606:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789265674.875945:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789265674.877330:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789265674.879127:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1789265674.886127:0:18645:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789265674.887120:0:18645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789265674.887139:0:18645:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789265674.887161:0:18645:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbbfdc9019c1d4d40 00000020:01000004:0.0:1789265674.887174:0:18645:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789265674.887206:0:18645:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789265674.887211:0:18645:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789265674.887221:0:18645:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789265674.887227:0:18645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789265674.887248:0:18645:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9376433a8000) 00000020:00000080:0.0:1789265674.887276:0:18645:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1789265674.897718:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265674.898027:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789265674.898035:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789265674.898772:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789265674.898779:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789265674.898924:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789265674.898931:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789265674.902969:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265674.903167:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789265674.903173:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789265674.932141:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789265674.932165:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:3.0:1789265674.932252:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265674.966682:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265674.967014:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789265674.967028:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789265674.970837:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789265674.970895:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789265674.972948:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789265674.972964:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789265674.976359:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265674.976586:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789265674.976593:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789265674.986206:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789265674.986333:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789265675.087980:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265675.088210:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789265675.088216:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789265675.099138:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789265675.099153:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789265675.107849:0:18645:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789265675.107927:0:18645:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789265675.107934:0:18645:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789265675.133929:0:18645:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789265675.134008:0:18645:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.142@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789265675.134014:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789265675.134022:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789265675.134023:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265675.134024:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265675.134025:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265675.134027:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265675.134028:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265675.134030:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265675.134031:0:18645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265675.134035:0:18645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789265675.134037:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265675.134046:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789265675.134048:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265675.134048:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265675.134049:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265675.134050:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265675.134051:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265675.134052:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265675.134053:0:18645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265675.134094:0:18645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789265675.134118:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579056384:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789265675.134306:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265675.134349:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff937758111480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265675.134900:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579056384 00000100:00100000:2.0:1789265675.134909:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579056384 00000100:00100000:2.0:1789265675.134977:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265675.134987:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:18645:x1876180579056384:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789265675.135030:0:17137:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789265675.135033:0:17137:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789265675.135037:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789265675.135695:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:18645:x1876180579056384:12345-0@lo:253:mount.lustre.0 Request processed in 707us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.135704:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789265675.140640:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579056384:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789265675.140659:0:18645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789265675.140662:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265675.140664:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789265675.140665:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265675.140667:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265675.140668:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265675.140669:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265675.140670:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265675.140672:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265675.140674:0:18645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789265675.140704:0:18645:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93776128f000 from lustre-OST0000 10000000:01000000:0.0:1789265675.140741:0:18645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789265675.140744:0:18645:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789265675.140751:0:18645:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9376433ab370 local copy 00010000:00010000:0.0:1789265675.140776:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b02 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265675.140946:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579056512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265675.141009:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265675.141043:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff937758111d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265675.141415:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579056512 00000100:00100000:2.0:1789265675.141422:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579056512 00000100:00100000:2.0:1789265675.141475:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789265675.141485:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:18645:x1876180579056512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265675.141577:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:18645:x1876180579056512:12345-0@lo:501:mount.lustre.0 Request processed in 92us (567us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265675.141585:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789265675.141819:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579056512:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789265675.141836:0:18645:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789265675.141856:0:18645:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789265675.141898:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b02 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265675.141908:0:18645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b02 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265675.141937:0:18645:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93776128f000 10000000:01000000:0.0:1789265675.141942:0:18645:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789265675.141948:0:18645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789265675.141951:0:18645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265675.141956:0:18645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789265675.141959:0:18645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789265675.141982:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392c00/0xbbfdc9019c1d4d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265675.141990:0:18645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642392c00/0xbbfdc9019c1d4d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265675.141999:0:18645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642392c00/0xbbfdc9019c1d4d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265675.142031:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579056640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789265675.142060:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265675.142080:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff937758111d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265675.142233:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579056640 00000100:00100000:2.0:1789265675.142239:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579056640 00000100:00100000:2.0:1789265675.142276:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789265675.142284:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+18:18645:x1876180579056640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265675.142292:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265675.142306:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9376435fde00/0xbbfdc9019c1d4d55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4d4e expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.142336:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fde00/0xbbfdc9019c1d4d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d4e expref: 19 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.142347:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9376435fde00/0xbbfdc9019c1d4d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d4e expref: 19 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.142357:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fde00, rc 0) 00000100:00100000:2.0:1789265675.142407:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:18645:x1876180579056640:12345-0@lo:101:mount.lustre.0 Request processed in 123us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.142412:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789265675.142625:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579056640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265675.142637:0:18645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642392c00/0xbbfdc9019c1d4d4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d55 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265675.142646:0:18645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642392c00/0xbbfdc9019c1d4d4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4d55 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265675.151336:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789265675.153729:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265675.159955:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789265675.160012:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789265675.160027:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789265675.160038:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789265675.160050:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789265675.160061:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789265675.160097:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789265675.160110:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789265675.161600:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579056768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265675.161683:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265675.161725:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265675.161853:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579056768 00000100:00100000:2.0:1789265675.161881:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579056768 00000100:00100000:2.0:1789265675.161952:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789265675.161962:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:18645:x1876180579056768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265675.162117:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:18645:x1876180579056768:12345-0@lo:501:mount.lustre.0 Request processed in 156us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.162134:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789265675.162682:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579056768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265675.162726:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579056896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265675.162771:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265675.164730:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265675.168037:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579056896 00000100:00100000:1.0:1789265675.168054:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579056896 00000100:00100000:2.0:1789265675.169286:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789265675.169300:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:18645:x1876180579056896:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265675.172008:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:18645:x1876180579056896:12345-0@lo:503:mount.lustre.0 Request processed in 2703us (9227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.172021:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789265675.172202:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579056896:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265675.172701:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265675.172782:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265675.172846:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265675.193645:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265675.197370:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579057024 00000100:00100000:0.0:1789265675.197387:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579057024 00000100:00100000:0.0:1789265675.197509:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789265675.197521:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:18645:x1876180579057024:12345-0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265675.198605:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789265675.199273:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:18645:x1876180579057024:12345-0@lo:502:mount.lustre.0 Request processed in 1750us (26422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265675.199284:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789265675.199652:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265675.199995:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789265675.200029:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789265675.200045:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789265675.200056:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789265675.200069:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789265675.200083:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789265675.200098:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789265675.200110:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789265675.200387:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789265675.200493:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789265675.200509:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789265675.200524:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789265675.200572:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265675.200636:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265675.200667:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760042780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265675.200737:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579057152 00000100:00100000:0.0:1789265675.200743:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579057152 00000100:00100000:0.0:1789265675.200790:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789265675.200809:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:18645:x1876180579057152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265675.201230:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:18645:x1876180579057152:12345-0@lo:502:mount.lustre.0 Request processed in 421us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265675.201332:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789265675.201540:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265675.201595:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789265675.201605:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789265675.205569:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265675.205583:0:18662:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789265675.205590:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265675.205592:0:18662:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789265675.205598:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265675.205615:0:18662:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93775def0000) 00000020:00000080:3.0:1789265675.206467:0:18662:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789265675.206485:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789265675.206592:0:18662:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93776128f000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789265675.206601:0:18662:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789265675.206609:0:18662:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbbfdc9019c1d4d63 00010000:00010000:2.0:1789265675.218109:0:18662:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789265675.218908:0:18662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1789265675.221609:0:18662:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1789265675.223306:0:18662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789265675.223326:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265675.223332:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265675.223334:0:18662:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789265675.223338:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789265675.223341:0:18662:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1789265675.223342:0:18662:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265675.223344:0:18662:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265675.223345:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789265675.223348:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265675.223349:0:18662:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789265675.223352:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265675.223355:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265675.223356:0:18662:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265675.223359:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265675.223361:0:18662:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789265675.223363:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265675.223366:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265675.223367:0:18662:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789265675.223369:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265675.223371:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265675.223372:0:18662:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789265675.223374:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789265675.223415:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265675.223418:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265675.223420:0:18662:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789265675.223423:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789265675.235562:0:18645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789265675.235620:0:18645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789265675.235645:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392c00/0xbbfdc9019c1d4d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d55 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265675.235657:0:18645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642392c00/0xbbfdc9019c1d4d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d55 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265675.238006:0:18645:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93776128f000 from 1 10000000:01000000:0.0:1789265675.238015:0:18645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265675.238060:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265675.238084:0:18645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265675.238094:0:18645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265675.238122:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789265675.238201:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265675.238263:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774557f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265675.238442:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579057280 00000100:00100000:2.0:1789265675.238450:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579057280 00000100:00100000:2.0:1789265675.238502:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789265675.238511:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:18645:x1876180579057280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265675.238524:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265675.238539:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9376435fc200/0xbbfdc9019c1d4d71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4d6a expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.238580:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fc200/0xbbfdc9019c1d4d71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d6a expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.238591:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9376435fc200/0xbbfdc9019c1d4d71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d6a expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.238600:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc200, rc 0) 00000100:00100000:2.0:1789265675.238640:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:18645:x1876180579057280:12345-0@lo:101:mount.lustre.0 Request processed in 131us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.238647:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789265675.239187:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265675.239203:0:18645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d71 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265675.239214:0:18645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4d71 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265675.242758:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789265675.243123:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265675.243539:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789265675.243564:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789265675.243583:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789265675.243588:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789265675.243662:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265675.243732:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265675.243965:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579057408 00000100:00100000:2.0:1789265675.243973:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579057408 00000100:00100000:2.0:1789265675.244021:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789265675.244030:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:18645:x1876180579057408:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265675.244154:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:18645:x1876180579057408:12345-0@lo:501:mount.lustre.0 Request processed in 124us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.244161:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789265675.245897:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774557fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265675.245940:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265675.246000:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057536:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265675.246083:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265675.246121:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774557fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265675.248225:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579057536 00000100:00100000:2.0:1789265675.248250:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579057536 00000100:00100000:2.0:1789265675.248309:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789265675.248320:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:18645:x1876180579057536:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265675.248490:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:18645:x1876180579057536:12345-0@lo:503:mount.lustre.0 Request processed in 171us (2406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.248498:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789265675.248564:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057536:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789265675.249052:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265675.249380:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265675.249434:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.249468:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff937743426600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265675.249682:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579057664 00000100:00100000:2.0:1789265675.249687:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579057664 00000100:00100000:2.0:1789265675.249739:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789265675.249747:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:18645:x1876180579057664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265675.249873:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:18645:x1876180579057664:12345-0@lo:502:mount.lustre.0 Request processed in 113us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.249880:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789265675.249939:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789265675.252519:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789265675.252575:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789265675.252591:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789265675.252603:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789265675.252614:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789265675.252625:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789265675.252639:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789265675.252651:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1789265675.252666:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789265675.252680:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1789265675.252692:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1789265675.252740:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265675.252838:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265675.252901:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774557fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265675.257066:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579057792 00000100:00100000:2.0:1789265675.257083:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579057792 00000100:00100000:2.0:1789265675.257157:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789265675.257168:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:18645:x1876180579057792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265675.257371:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:18645:x1876180579057792:12345-0@lo:502:mount.lustre.0 Request processed in 205us (4532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.257379:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789265675.260889:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789265675.260992:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1789265675.261015:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789265675.263590:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265675.263602:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265675.263605:0:18666:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789265675.263611:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93776128f000 00000020:00000080:0.0:1789265675.263614:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265675.263622:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265675.263624:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265675.263626:0:18666:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789265675.263628:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265675.263630:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265675.263631:0:18666:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789265675.263634:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93776128f000 00000020:00000080:0.0:1789265675.263636:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265675.263707:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265675.263710:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265675.263711:0:18666:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789265675.263713:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265675.263716:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265675.263717:0:18666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789265675.263720:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93776128f000 00000020:00000080:0.0:1789265675.263722:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265675.263736:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265675.263738:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265675.263740:0:18666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789265675.263742:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265675.263744:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265675.263745:0:18666:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789265675.263748:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93776128f000 00000020:00000080:0.0:1789265675.263750:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265675.263767:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265675.263770:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265675.263771:0:18666:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789265675.263773:0:18666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789265675.264916:0:18645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789265675.264951:0:18645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265675.264975:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d71 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.264987:0:18645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d71 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265675.265047:0:18645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789265675.265050:0:18645:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93776128f000 10000000:01000000:2.0:1789265675.265053:0:18645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93776128f000 10000000:01000000:2.0:1789265675.265056:0:18645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789265675.265061:0:18645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93776128f000 from 1 10000000:01000000:2.0:1789265675.265064:0:18645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265675.265098:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc000/0xbbfdc9019c1d4d78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.265115:0:18645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9376435fc000/0xbbfdc9019c1d4d78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.265138:0:18645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9376435fc000/0xbbfdc9019c1d4d78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265675.265162:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265675.265228:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265675.265269:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579057920 00000100:00100000:2.0:1789265675.265275:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579057920 00000100:00100000:0.0:1789265675.267426:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377434313c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265675.280711:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789265675.280729:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:18645:x1876180579057920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265675.280746:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265675.280765:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9376435fc800/0xbbfdc9019c1d4d7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4d78 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.280805:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fc800/0xbbfdc9019c1d4d7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d78 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.280818:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9376435fc800/0xbbfdc9019c1d4d7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d78 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.280828:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9376435fc800, rc 0) 00000100:00100000:2.0:1789265675.280931:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:18645:x1876180579057920:12345-0@lo:101:mount.lustre.0 Request processed in 208us (15702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.280938:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789265675.280953:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579057920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265675.280972:0:18645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9376435fc000/0xbbfdc9019c1d4d78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d7f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265675.280982:0:18645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9376435fc000/0xbbfdc9019c1d4d78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4d7f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265675.302753:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789265675.303396:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265675.303626:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789265675.303651:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789265675.303664:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789265675.303675:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789265675.303688:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789265675.303700:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789265675.303712:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789265675.303725:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789265675.303738:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789265675.303750:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789265675.303763:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789265675.303774:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789265675.306020:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789265675.306915:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789265675.306947:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789265675.306963:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789265675.306998:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789265675.307012:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789265675.307036:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789265675.307049:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789265675.307062:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789265675.307546:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789265675.307565:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789265675.307579:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789265675.307593:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789265675.307607:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789265675.307620:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789265675.307635:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789265675.307650:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789265675.307662:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789265675.307675:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789265675.307687:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789265675.307716:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789265675.307731:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789265675.307745:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789265675.307758:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789265675.307771:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789265675.307819:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789265675.307826:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789265675.308872:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579058048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265675.308939:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265675.308982:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579058048 00000100:00100000:1.0:1789265675.308984:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265675.308996:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579058048 00000100:00100000:2.0:1789265675.309041:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789265675.309049:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:18645:x1876180579058048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265675.309188:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:18645:x1876180579058048:12345-0@lo:501:mount.lustre.0 Request processed in 140us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.309196:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265675.310805:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579058048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265675.310894:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579058176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265675.310956:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.310992:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265675.313800:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579058176 00000100:00100000:3.0:1789265675.313816:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579058176 00000100:00100000:3.0:1789265675.313896:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789265675.313906:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:18645:x1876180579058176:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265675.314057:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:18645:x1876180579058176:12345-0@lo:503:mount.lustre.0 Request processed in 153us (3101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265675.314065:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789265675.316315:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579058176:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789265675.316767:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265675.316894:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579058304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265675.316962:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.317008:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265675.317218:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579058304 00000100:00100000:2.0:1789265675.317224:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579058304 00000100:00100000:2.0:1789265675.317354:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789265675.317364:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:18645:x1876180579058304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265675.317544:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:18645:x1876180579058304:12345-0@lo:502:mount.lustre.0 Request processed in 181us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.317551:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789265675.318891:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579058304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265675.319150:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789265675.319176:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789265675.319188:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789265675.319198:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789265675.319209:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789265675.319219:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789265675.319247:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789265675.319261:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789265675.319273:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789265675.319283:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789265675.319294:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789265675.319304:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789265675.319315:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789265675.319326:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789265675.319336:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789265675.319346:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789265675.319356:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789265675.319366:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789265675.319377:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789265675.319387:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789265675.319399:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789265675.319411:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789265675.319434:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789265675.319447:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789265675.319458:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789265675.319476:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789265675.319486:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789265675.319496:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789265675.319506:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789265675.319516:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789265675.319526:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789265675.319536:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789265675.319546:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789265675.319556:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789265675.319566:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789265675.319576:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789265675.319586:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789265675.319596:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789265675.319618:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789265675.319629:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789265675.319640:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789265675.319650:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789265675.319660:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789265675.319670:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789265675.319681:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789265675.319692:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789265675.319703:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789265675.319715:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789265675.319757:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579058432:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265675.319835:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.319899:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff937750ebf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265675.321945:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579058432 00000100:00100000:2.0:1789265675.321960:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579058432 00000100:00100000:2.0:1789265675.322021:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789265675.322031:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:18645:x1876180579058432:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265675.322330:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:18645:x1876180579058432:12345-0@lo:502:mount.lustre.0 Request processed in 301us (2494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.322339:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789265675.322702:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579058432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265675.322969:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789265675.322996:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789265675.323031:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579058560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265675.323101:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265675.323593:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e610c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265675.326374:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579058560 00000100:00100000:0.0:1789265675.326387:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579058560 00000100:00100000:0.0:1789265675.326446:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789265675.326457:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:18645:x1876180579058560:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265675.326617:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:18645:x1876180579058560:12345-0@lo:502:mount.lustre.0 Request processed in 162us (3515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265675.326625:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789265675.327178:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579058560:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265675.327284:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789265675.327300:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789265675.333823:0:18671:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789265675.333842:0:18671:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93777a984d28) 00000020:00000080:1.0:1789265675.333886:0:18671:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789265675.333996:0:18671:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93776128f000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789265675.334000:0:18671:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93776128f000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789265675.334003:0:18671:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93776128f000 3 00010000:00080000:1.0:1789265675.334050:0:18671:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9376435bf800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1789265675.340005:0:18671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789265675.340195:0:18671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789265675.340250:0:18671:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789265675.340263:0:18671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbbfdc9019c1d4d8d 00000100:00080000:1.0:1789265675.340274:0:18671:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265675.340279:0:18671:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9376435bf800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1789265675.340326:0:18671:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f15a300 x1876180579058688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265675.340352:0:18671:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789265675.340407:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265675.340411:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265675.340413:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265675.340416:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265675.340429:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265675.340432:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265675.340434:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265675.340437:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789265675.340466:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3646:1876180579058816:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.340530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.340573:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180579059328:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.340600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.340621:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265675.340627:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579059200:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.340657:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265675.340769:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579058944:0@lo:400:kworker.0 00000100:00100000:3.0:1789265675.340811:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265675.340832:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265675.340837:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579059072:0@lo:400:kworker.0 00000100:00100000:3.0:1789265675.340882:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265675.341750:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180579058688:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789265675.341819:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265675.342373:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579058816 00000100:00100000:2.0:1789265675.342382:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579058816 00000100:00100000:3.0:1789265675.342539:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579059200 00000100:00100000:3.0:1789265675.342543:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579059200 00000100:00100000:3.0:1789265675.342572:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579058944 00000100:00100000:3.0:1789265675.342576:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579058944 00000100:00100000:3.0:1789265675.342593:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789265675.342602:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579059200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265675.342664:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579059200:12345-0@lo:400:kworker.0 Request processed in 62us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265675.342685:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789265675.342704:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265675.342711:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579058944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265675.342747:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579058944:12345-0@lo:400:kworker.0 Request processed in 37us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265675.342754:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265675.342776:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579059328 00000100:00100000:3.0:1789265675.342779:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579059328 00000100:00100000:3.0:1789265675.342808:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579059072 00000100:00100000:3.0:1789265675.342811:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579059072 00000100:00100000:3.0:1789265675.342823:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579058688 00000100:00100000:3.0:1789265675.342826:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579058688 00000100:00100000:3.0:1789265675.342837:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265675.342844:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180579059328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265675.342906:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180579059328:12345-0@lo:400:kworker.0 Request processed in 62us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265675.342913:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265675.342927:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265675.342933:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579059072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265675.342978:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579059072:12345-0@lo:400:kworker.0 Request processed in 44us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265675.342984:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265675.342997:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265675.343002:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876180579058688:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789265675.343025:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:3.0:1789265675.343069:0:17145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbbfdc9019c1d4d94 00000004:00100000:3.0:1789265675.343085:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789265675.343116:0:17145:0:(import.c:65:import_set_state_nolock()) ffff9377528e2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265675.343598:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789265675.343614:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:3646:x1876180579058816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265675.343659:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:3646:x1876180579058816:12345-0@lo:400:kworker.0 Request processed in 47us (3129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.343665:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000020:01000004:0.0:1789265675.345069:0:18671:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789265675.345099:0:18671:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9376426e8000) 00000020:00000080:0.0:1789265675.345121:0:18671:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1789265675.345229:0:18671:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93776128f000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789265675.345234:0:18671:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93776128f000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789265675.345236:0:18671:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93776128f000 3 00010000:00080000:0.0:1789265675.345264:0:18671:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9376431b0800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.142@tcp at head 00000100:00100000:3.0:1789265675.345547:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180579058688:12345-0@lo:38:llog_process_th.0 Request processed in 2541us (3725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265675.345557:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789265675.345616:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93774f15a300 x1876180579058688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265675.345627:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265675.345635:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789265675.345643:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789265675.345647:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789265675.345651:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376435bf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789265675.345657:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180579058688:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789265675.345703:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93774f159500 x1876180579059072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265675.345715:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579059072:0@lo:400:kworker.0 00000100:00100000:3.0:1789265675.345728:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579058944:0@lo:400:kworker.0 00000100:00100000:3.0:1789265675.345758:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579059200:0@lo:400:kworker.0 00000100:00100000:3.0:1789265675.345770:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3646:1876180579058816:0@lo:400:kworker.0 00010000:00080000:3.0:1789265675.345781:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93774f15b480 x1876180579059328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265675.345802:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180579059328:0@lo:400:kworker.0 00010000:00010000:0.0:1789265675.346783:0:18671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1789265675.347007:0:18671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789265675.347046:0:18671:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789265675.347057:0:18671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xbbfdc9019c1d4da2 00000100:00080000:0.0:1789265675.347071:0:18671:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265675.347076:0:18671:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9376431b0800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265675.347102:0:18671:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774e40c700 x1876180579059456/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265675.347122:0:18671:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789265675.348071:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265675.348077:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265675.348080:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265675.348083:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265675.348087:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265675.348090:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265675.348092:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265675.348094:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789265675.349370:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180579059456:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789265675.350637:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265675.351248:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579059456 00000100:00100000:0.0:1789265675.351257:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579059456 00000100:00100000:0.0:1789265675.351302:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265675.351312:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876180579059456:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789265675.351343:0:17144:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:0.0:1789265675.351372:0:17144:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xbbfdc9019c1d4da9 00000004:00100000:0.0:1789265675.351386:0:17144:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789265675.351417:0:17144:0:(import.c:65:import_set_state_nolock()) ffff9376431b0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265675.351477:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180579059456:12345-0@lo:38:llog_process_th.0 Request processed in 166us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265675.351486:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789265675.359630:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93774e40c700 x1876180579059456/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265675.359646:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265675.359656:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789265675.359665:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789265675.359670:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789265675.359674:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376431b0800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789265675.359680:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180579059456:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789265675.361631:0:18671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1789265675.361723:0:18645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789265675.361752:0:18645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789265675.361781:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9376435fc000/0xbbfdc9019c1d4d78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d7f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.361802:0:18645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9376435fc000/0xbbfdc9019c1d4d78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4d7f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789265675.361854:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789265675.361856:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789265675.361872:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265675.361874:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265675.361875:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265675.361876:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265675.361878:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265675.361879:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265675.361881:0:18645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789265675.361885:0:18645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789265675.361887:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789265675.361888:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789265675.361889:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265675.361890:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265675.361891:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265675.361892:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265675.361893:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265675.361894:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265675.361895:0:18645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789265675.361924:0:18645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789265675.361945:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579059584:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789265675.362020:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265675.362067:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff937743431c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265675.362983:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579059584 00000100:00100000:0.0:1789265675.362992:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579059584 00000100:00100000:0.0:1789265675.363044:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789265675.363053:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:18645:x1876180579059584:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789265675.363089:0:17136:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789265675.363102:0:17136:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789265675.372941:0:17136:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789265675.372962:0:17136:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789265675.374038:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789265675.374047:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:2.0:1789265675.374174:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:18645:x1876180579059584:12345-0@lo:253:mount.lustre.0 Request processed in 11117us (12149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265675.374186:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:2.0:1789265675.374233:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.374249:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4cfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4cf3 expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.374257:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bd000/0xbbfdc9019c1d4d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d01 expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.374264:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.374301:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bd000/0xbbfdc9019c1d4d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d4d01 expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.374316:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9377532bd000/0xbbfdc9019c1d4d08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d01 expref: 20 pid: 17137 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265675.374330:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1876180579059712:0@lo:104: 00000100:00100000:2.0:1789265675.374364:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265675.374409:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d4cf3 expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.374417:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4cfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cf3 expref: 20 pid: 17137 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265675.374441:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1876180579059840:0@lo:104: 00000100:00100000:2.0:1789265675.374467:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265675.374491:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e72c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265675.374534:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:18645:1876180579059584:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789265675.374553:0:18645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789265675.374556:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265675.374558:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789265675.374559:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265675.374561:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265675.374562:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265675.374563:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265675.374565:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265675.374567:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265675.374568:0:18645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789265675.374582:0:18645:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789265675.374660:0:17128:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789265675.374679:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579059712 00000100:00100000:1.0:1789265675.374684:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579059712 00000100:00100000:1.0:1789265675.374713:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579059840 00000100:00100000:1.0:1789265675.374716:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579059840 00000100:00100000:1.0:1789265675.374730:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265675.374739:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+4:17159:x1876180579059712:12345-0@lo:104: 00010000:00010000:1.0:1789265675.374750:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4d08 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.374814:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265675.374820:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+4:17159:x1876180579059712:12345-0@lo:104: Request processed in 82us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.374826:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265675.374841:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265675.374846:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643552850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+3:17159:x1876180579059840:12345-0@lo:104: 00010000:00010000:1.0:1789265675.374918:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4cfa expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.374952:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789265675.374957:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643552850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+3:17159:x1876180579059840:12345-0@lo:104: Request processed in 112us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.374963:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789265675.375001:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265675.375008:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4d08 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375015:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392a00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265675.375019:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d4d08 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375026:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d4d08 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265675.375033:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d4d08 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265675.375039:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265675.375076:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4d08 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375083:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265675.375101:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4d08 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375108:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937642392a00/0xbbfdc9019c1d4d01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4d08 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375124:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265675.375127:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4cfa expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375284:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393e00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:1.0:1789265675.375287:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d4cfa expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375295:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d4cfa expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265675.375302:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d4cfa expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265675.375307:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789265675.375321:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4cfa expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375326:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265675.375333:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4cfa expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375339:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937642393e00/0xbbfdc9019c1d4cf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4cfa expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375352:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265675.375353:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265675.375355:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265675.375362:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265675.375386:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579059968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265675.375414:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.375446:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265675.375452:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579060096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265675.375476:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.375508:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579059968 00000100:00100000:1.0:1789265675.375512:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579059968 00010000:00010000:1.0:1789265675.375530:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bd000/0xbbfdc9019c1d4d08 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d01 expref: 21 pid: 17137 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265675.375551:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579060096 00000100:00100000:1.0:1789265675.375554:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579060096 00010000:00010000:1.0:1789265675.375565:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4cfa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cf3 expref: 22 pid: 17137 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265675.375583:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265675.375589:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:3643:x1876180579059968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265675.375599:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265675.375604:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bd000/0xbbfdc9019c1d4d08 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d01 expref: 22 pid: 17137 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375614:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bd000/0xbbfdc9019c1d4d08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d01 expref: 22 pid: 17137 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375630:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265675.375657:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:3643:x1876180579059968:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.375664:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265675.375676:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265675.375683:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643659050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:3643:x1876180579060096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265675.375696:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265675.375701:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4cfa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cf3 expref: 21 pid: 17137 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375710:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4cfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cf3 expref: 21 pid: 17137 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375721:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375730:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789265675.375742:0:17130:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012514975s 00010000:00010000:1.0:1789265675.375747:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375755:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375762:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375768:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375774:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265675.375778:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375786:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375811:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265675.375821:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265675.375843:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643659050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:3643:x1876180579060096:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.375850:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265675.375937:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579060096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265675.375946:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579059968:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265675.376401:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bd000/0xbbfdc9019c1d4d08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d01 expref: 20 pid: 17137 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265675.376414:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1876180579059712:0@lo:104: 00010000:00010000:2.0:1789265675.376424:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4cfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d4cf3 expref: 19 pid: 17137 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265675.376431:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1876180579059840:0@lo:104: 00010000:00010000:2.0:1789265675.376446:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.376455:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.376462:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265675.376467:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9376435fd600/0xbbfdc9019c1d4db0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1789265675.385537:0:18645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789265675.392333:0:18645:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789265675.392344:0:18645:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789265675.392384:0:18645:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789265675.392424:0:18645:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789265675.392441:0:18645:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789265675.392468:0:18645:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789265675.393369:0:18645:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265675.393581:0:18645:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789265675.955415:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789265676.646971:0:18725:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265676.647528:0:18725:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789265676.980567:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789265677.176645:0:17141:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789265677.176653:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93775f5f4800 from 9 10000000:01000000:1.0:1789265677.176658:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265677.176707:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265677.176720:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265677.176732:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265677.176759:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579060224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265677.176853:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265677.176932:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579060224 00000100:00100000:1.0:1789265677.176934:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377612d4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265677.176940:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579060224 00000100:00100000:0.0:1789265677.177004:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789265677.177015:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+19:17141:x1876180579060224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265677.177042:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265677.177055:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937642392400/0xbbfdc9019c1d4dbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4db7 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265677.177077:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642392400/0xbbfdc9019c1d4dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4db7 expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265677.177087:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937642392400/0xbbfdc9019c1d4dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4db7 expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265677.177096:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392400, rc 0) 00000100:00100000:0.0:1789265677.177148:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:17141:x1876180579060224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265677.177155:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789265677.178938:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579060224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265677.178960:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4dbe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265677.178972:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4dbe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265677.179055:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579060352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789265677.179111:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265677.179161:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e637c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265677.179711:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579060352 00000100:00100000:0.0:1789265677.179720:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579060352 00000100:00100000:0.0:1789265677.179783:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789265677.179794:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:17141:x1876180579060352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789265677.179814:0:17136:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789265677.179832:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789265677.179836:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1789265677.179973:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:17141:x1876180579060352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 181us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265677.179982:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789265677.180080:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579060352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789265677.180146:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789265677.180155:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4dbe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265677.180174:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4dbe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265677.180185:0:17141:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789265677.180187:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93777f58d800 from 9 10000000:01000000:3.0:1789265677.180190:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789265677.180213:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265677.180221:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265677.180230:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265677.180244:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579060480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265677.180274:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265677.180308:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e637c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265677.180374:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579060480 00000100:00100000:1.0:1789265677.180379:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579060480 00000100:00100000:1.0:1789265677.180424:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789265677.180432:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643513450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:17141:x1876180579060480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265677.180441:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265677.180453:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4dcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4dc5 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265677.180473:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4dcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4dc5 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265677.180483:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4dcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4dc5 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265677.180491:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc800, rc 0) 00000100:00100000:1.0:1789265677.180523:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643513450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:17141:x1876180579060480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265677.180529:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789265677.180619:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579060480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265677.180631:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4dcc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265677.180639:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4dcc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265677.180676:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579060608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789265677.180702:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265677.180729:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774e637c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265677.180846:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579060608 00000100:00100000:1.0:1789265677.180851:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579060608 00000100:00100000:1.0:1789265677.180902:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789265677.180909:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:17141:x1876180579060608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789265677.180919:0:17138:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789265677.180932:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789265677.180935:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789265677.180998:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:17141:x1876180579060608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 89us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265677.181005:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789265677.181792:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579060608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789265677.181898:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789265677.181907:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4dcc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265677.181916:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4dcc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265678.004850:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265679.027025:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265679.860000:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579060736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265679.860067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265679.860125:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579060736 00000100:00100000:3.0:1789265679.860132:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579060736 00000100:00100000:1.0:1789265679.860404:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579060864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265679.860449:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265679.860489:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579060864 00000100:00100000:1.0:1789265679.860493:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579060864 00000100:00100000:1.0:1789265679.860523:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789265679.860531:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579060864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265679.860563:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789265679.860607:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579060864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265679.860613:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789265679.860655:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579060864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265679.861147:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265679.861164:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579060736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265679.861183:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265679.861219:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579060736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265679.861226:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789265679.868095:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579060736:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789265680.052032:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265680.372112:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579060992:0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.372192:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265680.375388:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265680.375414:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579061120:0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.375617:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265680.375678:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579061120 00000100:00100000:1.0:1789265680.375685:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579061120 00000100:00100000:1.0:1789265680.375732:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789265680.375742:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579061120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.375814:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579061120:12345-0@lo:400:kworker.0 Request processed in 72us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265680.375821:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789265680.375881:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579061120:0@lo:400:kworker.0 00000100:00080000:3.0:1789265680.376163:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265680.376169:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265680.376172:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265680.376175:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265680.376220:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265680.376223:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265680.376232:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265680.376235:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789265680.376359:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180579061632:0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.376396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265680.376419:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265680.376426:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180579061504:0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.376461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265680.376653:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579061248:0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.376680:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265680.376702:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180579061760:0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.376723:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265680.376736:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265680.376742:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579061376:0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.376779:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265680.376818:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579061632 00000100:00100000:3.0:1789265680.376823:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579061632 00000100:00100000:3.0:1789265680.376881:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579061504 00000100:00100000:3.0:1789265680.376885:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579061504 00000100:00100000:3.0:1789265680.376899:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579061248 00000100:00100000:3.0:1789265680.376901:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579061248 00000100:00100000:3.0:1789265680.376913:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579061760 00000100:00100000:3.0:1789265680.376915:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579061760 00000100:00100000:3.0:1789265680.376932:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265680.376939:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180579061632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.376981:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180579061632:12345-0@lo:400:kworker.0 Request processed in 42us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265680.376999:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265680.377015:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265680.377021:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180579061504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.377050:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180579061504:12345-0@lo:400:kworker.0 Request processed in 29us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265680.377056:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265680.377067:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265680.377073:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579061248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.377102:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579061248:12345-0@lo:400:kworker.0 Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265680.377108:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265680.377119:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265680.377126:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180579061760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.377151:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180579061760:12345-0@lo:400:kworker.0 Request processed in 26us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265680.377157:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789265680.377197:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9376434d5180 x1876180579061504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265680.377210:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180579061504:0@lo:400:kworker.0 00010000:00080000:3.0:1789265680.377222:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f2ff100 x1876180579061632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265680.377231:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180579061632:0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.377253:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579061376 00000100:00100000:3.0:1789265680.377343:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579061376 00000100:00100000:3.0:1789265680.377372:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265680.377379:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579061376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.377410:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579061376:12345-0@lo:400:kworker.0 Request processed in 31us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265680.377416:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265680.377582:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579061376:0@lo:400:kworker.0 00010000:00080000:3.0:1789265680.377599:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9376434d5c00 x1876180579061248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265680.377609:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579061248:0@lo:400:kworker.0 00010000:00080000:3.0:1789265680.377620:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f2ff480 x1876180579061760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265680.377628:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180579061760:0@lo:400:kworker.0 00000100:00080000:1.0:1789265680.377803:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265680.377808:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265680.402722:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579060992 00000100:00100000:2.0:1789265680.402738:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579060992 00000100:00100000:2.0:1789265680.402805:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789265680.402816:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:3643:x1876180579060992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265680.402935:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:3643:x1876180579060992:12345-0@lo:400:kworker.0 Request processed in 120us (30741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265680.402942:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789265680.404851:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579060992:0@lo:400:kworker.0 00010000:00010000:1.0:1789265681.075107:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789265681.353234:0:19015:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1789265681.718616:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789265682.099152:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789265682.241412:0:19067:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265682.241584:0:19067:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1789265682.873523:0:19117:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265682.873856:0:19117:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789265683.123097:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265684.148019:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265684.596192:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265669/real 1789265669] req@ffff93777f582a00 x1876180579055104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265684 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265684.596223:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93777f582a00 x1876180579055104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265684 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265684.596234:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265669/real 1789265669] req@ffff93777f583100 x1876180579055232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265684 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265684.596245:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93777f583100 x1876180579055232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265684 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265684.596263:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376424d5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265684.596287:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789265684.596291:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579055104:0@lo:8:kworker.0 00000100:00080000:2.0:1789265684.596297:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937747e2e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265684.596302:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789265684.596306:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579055232:0@lo:8:kworker.0 00000100:00080000:3.0:1789265684.596424:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265684.596429:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265684.596432:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265684.596435:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265684.596449:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265684.596452:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789265684.596460:0:8:0:(import.c:65:import_set_state_nolock()) ffff9376424d5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265684.596464:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 525 00000100:00080000:3.0:1789265684.596469:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789265684.596475:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9376424d5000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265684.596493:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f2ffb80 x1876180579062400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265684.596506:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265684.596509:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789265684.596511:0:8:0:(import.c:65:import_set_state_nolock()) ffff937747e2e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265684.596513:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 525 00000100:00080000:3.0:1789265684.596516:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789265684.596519:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff937747e2e800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265684.596539:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f2fd180 x1876180579062528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265684.596579:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579062272:0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.596636:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265684.596680:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789265684.596686:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579061888:0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.596730:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265684.596753:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579062656:0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.596774:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265684.596798:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579062016:0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.596820:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265684.596835:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180579062784:0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.596885:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265684.596904:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789265684.596909:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579062144:0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.596933:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265684.596948:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180579062912:0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.596966:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265684.596988:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579062272 00000100:00100000:3.0:1789265684.596995:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579062272 00000100:00100000:3.0:1789265684.597028:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579062016 00000100:00100000:3.0:1789265684.597031:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579062016 00000100:00100000:3.0:1789265684.597044:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789265684.597051:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579062272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.597099:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579062272:12345-0@lo:400:kworker.0 Request processed in 47us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265684.597106:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789265684.597122:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789265684.597127:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579062016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.597157:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579062016:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265684.597163:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789265684.597178:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579061888 00000100:00100000:3.0:1789265684.597181:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579061888 00000100:00100000:3.0:1789265684.597199:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789265684.597205:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:3645:x1876180579061888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.597233:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:3645:x1876180579061888:12345-0@lo:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265684.597246:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789265684.597270:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579062656 00000100:00100000:3.0:1789265684.597273:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579062656 00000100:00100000:3.0:1789265684.597289:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579062784 00000100:00100000:3.0:1789265684.597292:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579062784 00000100:00100000:3.0:1789265684.597314:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579062144 00000100:00100000:3.0:1789265684.597317:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579062144 00000100:00100000:3.0:1789265684.597325:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579062912 00000100:00100000:3.0:1789265684.597327:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579062912 00000100:00100000:3.0:1789265684.597339:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265684.597344:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579062656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.597373:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579062656:12345-0@lo:400:kworker.0 Request processed in 28us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265684.597379:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265684.597390:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265684.597395:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180579062784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.597417:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180579062784:12345-0@lo:400:kworker.0 Request processed in 22us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265684.597423:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265684.597432:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265684.597438:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579062144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.597462:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579062144:12345-0@lo:400:kworker.0 Request processed in 24us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265684.597467:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265684.597477:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789265684.597482:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180579062912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.597514:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180579062912:12345-0@lo:400:kworker.0 Request processed in 32us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265684.597520:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789265684.597546:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265684.597551:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789265684.597570:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f2fed80 x1876180579062144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265684.597583:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579062144:0@lo:400:kworker.0 00010000:00080000:3.0:1789265684.597594:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f2fdf80 x1876180579062912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265684.597603:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180579062912:0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.597612:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579062016:0@lo:400:kworker.0 00010000:00080000:3.0:1789265684.597621:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f2fea00 x1876180579062784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265684.597628:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180579062784:0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.597652:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579061888:0@lo:400:kworker.0 00010000:00080000:3.0:1789265684.597662:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f2fd500 x1876180579062656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265684.597671:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579062656:0@lo:400:kworker.0 00000100:00100000:3.0:1789265684.597680:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579062272:0@lo:400:kworker.0 00000100:00100000:2.0:1789265684.597845:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579062400:0@lo:8:kworker.0 00000100:00100000:2.0:1789265684.597888:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265684.597926:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579062528:0@lo:8:kworker.0 00000100:00100000:2.0:1789265684.597947:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265684.598853:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579062400 00000100:00100000:3.0:1789265684.598885:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579062400 00000100:00100000:3.0:1789265684.598916:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579062528 00000100:00100000:3.0:1789265684.598920:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579062528 00000100:00100000:3.0:1789265684.598932:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265684.598938:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876180579062400:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789265684.598963:0:18650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:3.0:1789265684.598987:0:18650:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbbfdc9019c1d4dd3 00002000:00100000:3.0:1789265684.599001:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9377528e7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789265684.599005:0:18650:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789265684.599008:0:18650:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789265684.599165:0:18650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789265684.599185:0:18650:0:(import.c:65:import_set_state_nolock()) ffff9377528e0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265684.599237:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876180579062400:12345-0@lo:8:kworker.0 Request processed in 298us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265684.599244:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265684.599258:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789265684.599262:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876180579062528:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789265684.599273:0:18650:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1789265684.602295:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f2ffb80 x1876180579062400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265684.602311:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265684.602321:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789265684.602329:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789265684.602334:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789265684.602337:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9376424d5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789265684.602365:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789265684.602371:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579062400:0@lo:8:kworker.0 00000004:00080000:2.0:1789265684.603097:0:17885:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789265684.603190:0:17885:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 540264329933ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789265684.603198:0:17885:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789265684.604724:0:17886:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789265684.604753:0:17886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17886:1876180579063168:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789265684.604820:0:17886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265684.604884:0:17886:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377509d4240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265684.605061:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789265684.605069:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789265684.605153:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265684.605166:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579063040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265684.605191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265684.605239:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579063168 00000100:00100000:0.0:1789265684.605245:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579063168 00000100:00100000:0.0:1789265684.605352:0:19187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265684.605361:0:19187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17886:x1876180579063168:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:2.0:1789265684.605910:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265684.609780:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579063040 00000100:00100000:0.0:1789265684.609798:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579063040 00000100:00100000:0.0:1789265684.609875:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265684.609887:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1876180579063040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265684.609921:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789265684.609999:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1876180579063040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (4806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265684.610006:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789265684.610050:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774e40c380 x1876180579063040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265684.610071:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579063040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265684.612441:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876180579062528:12345-0@lo:8:kworker.0 Request processed in 13171us (14486us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789265684.612453:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789265684.612909:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937747e2e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265684.612916:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265684.612921:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579062528:0@lo:8:kworker.0 00002000:00080000:0.0:1789265684.613055:0:19187:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789265684.613061:0:19187:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789265684.613104:0:19187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17886:x1876180579063168:12345-0@lo:7:osp-pre-0-1.0 Request processed in 7744us (8283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265684.613119:0:19187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789265684.613154:0:17886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774e40ea00 x1876180579063168/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265700 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265684.613167:0:17886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17886:1876180579063168:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789265684.613177:0:17886:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789265684.613209:0:17886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17886:1876180579063296:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789265684.613241:0:17886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265684.613261:0:17886:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377509d4240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265684.613274:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579063296 00000100:00100000:0.0:1789265684.613279:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579063296 00000100:00100000:0.0:1789265684.613313:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265684.613321:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17886:x1876180579063296:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789265684.613341:0:18651:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1789265684.613370:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17886:x1876180579063296:12345-0@lo:5:osp-pre-0-1.0 Request processed in 50us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265684.613377:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789265684.613398:0:17886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774e40ea00 x1876180579063296/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265700 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265684.613408:0:17886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17886:1876180579063296:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789265684.613415:0:17886:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789265684.613437:0:17886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17886:1876180579063424:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789265684.613458:0:17886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265684.613469:0:17886:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377509d4240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265684.613479:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579063424 00000100:00100000:0.0:1789265684.613487:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579063424 00000100:00100000:0.0:1789265684.613504:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265684.613510:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17886:x1876180579063424:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789265684.613542:0:18651:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:3.0:1789265684.614000:0:17877:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:0.0:1789265684.639506:0:18646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789265684.639521:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789265684.639797:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17886:x1876180579063424:12345-0@lo:5:osp-pre-0-1.0 Request processed in 26283us (26334us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789265684.639812:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789265684.640152:0:17886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774e40ea00 x1876180579063424/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265700 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265684.640164:0:17886:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789265684.640171:0:17886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17886:1876180579063424:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789265684.640185:0:17886:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1789265684.640233:0:17886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17886:1876180579063552:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789265684.640268:0:17886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265684.640298:0:17886:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377509d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265684.640359:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579063552 00000100:00100000:2.0:1789265684.640366:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579063552 00000100:00100000:2.0:1789265684.640406:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265684.640414:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17886:x1876180579063552:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789265684.640461:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17886:x1876180579063552:12345-0@lo:900:osp-pre-0-1.0 Request processed in 47us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265684.640468:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265684.640491:0:17886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774e40ea00 x1876180579063552/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265700 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265684.640518:0:17886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17886:1876180579063552:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789265684.979516:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579063680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265684.979587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265684.979644:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579063680 00000100:00100000:1.0:1789265684.979652:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579063680 00000100:00100000:1.0:1789265684.979698:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265684.979718:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579063680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265684.979752:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789265684.979797:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579063680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265684.979805:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265684.979851:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579063680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265684.980255:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265684.980265:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579063808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265684.980307:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265684.981190:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579063808 00000100:00100000:1.0:1789265684.981197:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579063808 00000100:00100000:1.0:1789265684.981241:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265684.981249:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579063808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265684.981273:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789265684.981332:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579063808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265684.981340:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265684.982831:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579063808:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789265685.177783:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265685.427626:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789265686.196028:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265687.219778:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265688.265315:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265688.706319:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265668/real 1789265668] req@ffff93774f37e680 x1876180579053952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265688 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265688.706350:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93774f37e680 x1876180579053952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265688 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265688.708563:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265668/real 1789265668] req@ffff93774f37f100 x1876180579054080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265688 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265688.708610:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93774f37f100 x1876180579054080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265688 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789265688.708632:0:3642:0:(import.c:65:import_set_state_nolock()) ffff93775dcee800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265688.708644:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789265688.708649:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579053952:0@lo:8:kworker.0 00000100:00080000:0.0:1789265688.708654:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937760304800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265688.708659:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789265688.709097:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579054080:0@lo:8:kworker.0 00000100:00080000:3.0:1789265688.720514:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265688.720520:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789265688.720524:0:38:0:(import.c:65:import_set_state_nolock()) ffff93775dcee800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265688.720531:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:3.0:1789265688.720537:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789265688.720554:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93775dcee800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265688.720578:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f2fd180 x1876180579064192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265688.720595:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265688.720598:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789265688.720600:0:38:0:(import.c:65:import_set_state_nolock()) ffff937760304800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265688.720603:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:3.0:1789265688.720606:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789265688.720610:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff937760304800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265688.720620:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f2ffb80 x1876180579064320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265688.720642:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265688.720645:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789265688.720646:0:38:0:(import.c:65:import_set_state_nolock()) ffff937747e2e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265688.720649:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 540 00000100:00080000:3.0:1789265688.720651:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789265688.720654:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff937747e2e800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1789265688.720697:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93774f2fea00 x1876180579064832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265688.724851:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579064576:0@lo:400:kworker.0 00000100:00100000:0.0:1789265688.724950:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265688.725078:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180579065216:0@lo:400:kworker.0 00000100:00100000:0.0:1789265688.725112:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265688.725153:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789265688.725161:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579063936:0@lo:400:kworker.0 00000100:00100000:0.0:1789265688.725189:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265688.725211:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579064704:0@lo:400:kworker.0 00000100:00100000:0.0:1789265688.725233:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265688.725264:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579065216 00000100:00100000:0.0:1789265688.725271:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579065216 00000100:00100000:0.0:1789265688.725333:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265688.725345:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180579065216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265688.725398:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180579065216:12345-0@lo:400:kworker.0 Request processed in 58us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265688.725424:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265688.725449:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579063936 00000100:00100000:0.0:1789265688.725452:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579063936 00000100:00100000:0.0:1789265688.725475:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789265688.725481:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:3643:x1876180579063936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265688.725511:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:3643:x1876180579063936:12345-0@lo:400:kworker.0 Request processed in 30us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265688.725518:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789265688.725543:0:19187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579064704 00000100:00100000:0.0:1789265688.725546:0:19187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579064704 00000100:00100000:0.0:1789265688.725574:0:19187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265688.725581:0:19187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579064704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265688.725610:0:19187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579064704:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265688.725616:0:19187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265688.725650:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579063936:0@lo:400:kworker.0 00000100:00100000:2.0:1789265688.726190:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579064064:0@lo:400:kworker.0 00000100:00100000:2.0:1789265688.726222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265688.726243:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579064960:0@lo:400:kworker.0 00000100:00100000:2.0:1789265688.726262:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265688.726279:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789265688.726284:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579064448:0@lo:400:kworker.0 00000100:00100000:2.0:1789265688.726301:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265688.726315:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180579065088:0@lo:400:kworker.0 00000100:00100000:2.0:1789265688.726333:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789265688.726352:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265688.726356:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789265688.726364:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579064960 00000100:00100000:2.0:1789265688.726367:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579064960 00000100:00100000:2.0:1789265688.726388:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579064448 00000100:00100000:2.0:1789265688.726390:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579064448 00000100:00100000:2.0:1789265688.726397:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579065088 00000100:00100000:2.0:1789265688.726399:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579065088 00000100:00100000:2.0:1789265688.726414:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265688.726420:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579064960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265688.726450:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579064960:12345-0@lo:400:kworker.0 Request processed in 30us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265688.726455:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265688.726466:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265688.726481:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579064448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265688.726507:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579064448:12345-0@lo:400:kworker.0 Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265688.726512:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265688.726523:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265688.726529:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180579065088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265688.726550:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180579065088:12345-0@lo:400:kworker.0 Request processed in 22us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265688.726555:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789265688.726566:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789265688.726584:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f2fe300 x1876180579064448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265688.726596:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579064448:0@lo:400:kworker.0 00010000:00080000:2.0:1789265688.726605:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f2fdf80 x1876180579065088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265688.726613:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180579065088:0@lo:400:kworker.0 00010000:00080000:2.0:1789265688.726621:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f2ff100 x1876180579064960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265688.726628:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579064960:0@lo:400:kworker.0 00000100:00100000:1.0:1789265688.728385:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579064576 00000100:00100000:1.0:1789265688.728397:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579064576 00000100:00100000:1.0:1789265688.728431:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579064064 00000100:00100000:1.0:1789265688.728434:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579064064 00000100:00100000:1.0:1789265688.728452:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265688.728461:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579064576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265688.728534:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579064576:12345-0@lo:400:kworker.0 Request processed in 74us (3584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265688.728541:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789265688.728557:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265688.728563:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579064064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265688.728605:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579064064:12345-0@lo:400:kworker.0 Request processed in 43us (2381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265688.728611:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265688.729058:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579064192:0@lo:8:kworker.0 00000100:00100000:1.0:1789265688.729097:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265688.729131:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579064192 00000100:00100000:1.0:1789265688.729135:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579064192 00000100:00100000:1.0:1789265688.729151:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265688.729156:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876180579064192:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789265688.729181:0:18652:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:1.0:1789265688.729210:0:18652:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbbfdc9019c1d4dda 00002000:00100000:1.0:1789265688.729223:0:18652:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9376435bf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789265688.729227:0:18652:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789265688.729230:0:18652:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789265688.729299:0:18652:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789265688.729331:0:18652:0:(import.c:65:import_set_state_nolock()) ffff9376435b9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265688.729364:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180579064192:12345-0@lo:8:kworker.0 Request processed in 206us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265688.729371:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789265688.729414:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f2fd180 x1876180579064192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265688.729424:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265688.729432:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789265688.729439:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789265688.729444:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789265688.729446:0:3642:0:(import.c:65:import_set_state_nolock()) ffff93775dcee800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789265688.729459:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789265688.729464:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579064192:0@lo:8:kworker.0 00000100:00100000:1.0:1789265688.729471:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579064320:0@lo:8:kworker.0 00000100:00100000:1.0:1789265688.729496:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265688.729512:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579064832:0@lo:8:kworker.0 00000100:00100000:1.0:1789265688.729537:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265688.729554:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579064320 00000100:00100000:1.0:1789265688.729558:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579064320 00000100:00100000:1.0:1789265688.729572:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579064832 00000100:00100000:1.0:1789265688.729574:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579064832 00000100:00100000:1.0:1789265688.729583:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265688.729588:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876180579064320:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789265688.729599:0:18650:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265688.729623:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876180579064320:12345-0@lo:8:kworker.0 Request processed in 34us (127us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265688.729629:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265688.729647:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265688.729651:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876180579064832:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789265688.729662:0:18650:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265688.729701:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876180579064832:12345-0@lo:8:kworker.0 Request processed in 48us (162us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265688.729708:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789265688.729732:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937747e2e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265688.729736:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789265688.729739:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579064832:0@lo:8:kworker.0 00000100:00080000:1.0:1789265688.729761:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937760304800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265688.729764:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789265688.729767:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579064320:0@lo:8:kworker.0 00000004:00080000:1.0:1789265688.729818:0:17167:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789265688.729901:0:17167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 544391040856ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789265688.729907:0:17167:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789265688.729957:0:17168:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1789265688.729975:0:17168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1876180579065472:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789265688.729999:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265688.730014:0:17168:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377461bbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265688.730028:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579065472 00000100:00100000:1.0:1789265688.730032:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579065472 00000100:00100000:1.0:1789265688.730063:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265688.730069:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17168:x1876180579065472:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:0.0:1789265688.730909:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f2ff480 x1876180579064704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265688.730922:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579064704:0@lo:400:kworker.0 00000100:00100000:0.0:1789265688.730944:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579064576:0@lo:400:kworker.0 00010000:00080000:0.0:1789265688.730956:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f2fed80 x1876180579065216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265688.730965:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180579065216:0@lo:400:kworker.0 00000100:00100000:0.0:1789265688.730987:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265688.731002:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579065344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265688.731042:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265688.731568:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579064064:0@lo:400:kworker.0 00000100:00080000:2.0:1789265688.731832:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265688.732409:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579065344 00000100:00100000:1.0:1789265688.732417:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579065344 00000100:00100000:1.0:1789265688.732457:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265688.732474:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876180579065344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265688.732502:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789265688.732569:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876180579065344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265688.732576:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789265688.733177:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93774f158380 x1876180579065344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265688.733194:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579065344:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1789265688.737238:0:18650:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789265688.737250:0:18650:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789265688.737255:0:18650:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000004:00080000:1.0:1789265688.743074:0:17124:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789265688.772809:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265688.772825:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d1cba13/0xbbfdc9019c1d4de1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.774155:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1789265688.774161:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265688.774178:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d1cba13/0xbbfdc9019c1d4de1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.774200:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d1cba13/0xbbfdc9019c1d4de1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.774213:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d1cba13/0xbbfdc9019c1d4de1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.774221:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d1cba13/0xbbfdc9019c1d4de1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.774244:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265688.774258:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265688.774264:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d1cba13/0xbbfdc9019c1d4de1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.774271:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265688.774275:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d1cba13/0xbbfdc9019c1d4de1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.774284:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d1cba13/0xbbfdc9019c1d4de1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.774300:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d1cba13/0xbbfdc9019c1d4de1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.774318:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d1cba13/0xbbfdc9019c1d4de1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.774341:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265688.774343:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265688.774344:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265688.775587:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265688.775598:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091a9fc58/0xbbfdc9019c1d4de8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.775611:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1789265688.775616:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265688.775621:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091a9fc58/0xbbfdc9019c1d4de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.775632:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091a9fc58/0xbbfdc9019c1d4de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.775642:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091a9fc58/0xbbfdc9019c1d4de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.775650:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091a9fc58/0xbbfdc9019c1d4de8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.775688:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.775957:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.775965:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091a9fc58/0xbbfdc9019c1d4de8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.775973:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4a00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.775976:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091a9fc58/0xbbfdc9019c1d4de8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.775984:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091a9fc58/0xbbfdc9019c1d4de8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.775999:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091a9fc58/0xbbfdc9019c1d4de8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.776006:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091a9fc58/0xbbfdc9019c1d4de8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.776024:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.776025:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.776027:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265688.776460:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265688.776471:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a8082d/0xbbfdc9019c1d4def lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.776480:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1789265688.776483:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265688.776487:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046a8082d/0xbbfdc9019c1d4def lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.776497:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046a8082d/0xbbfdc9019c1d4def lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.776505:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a8082d/0xbbfdc9019c1d4def lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.776511:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046a8082d/0xbbfdc9019c1d4def lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.776534:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265688.777555:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265688.777564:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f4ab10c/0xbbfdc9019c1d4df6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777576:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1789265688.777579:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265688.777583:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f4ab10c/0xbbfdc9019c1d4df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777595:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f4ab10c/0xbbfdc9019c1d4df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777612:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f4ab10c/0xbbfdc9019c1d4df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777619:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f4ab10c/0xbbfdc9019c1d4df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777637:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789265688.777646:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265688.777651:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046a8082d/0xbbfdc9019c1d4def lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777658:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5e00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265688.777678:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a8082d/0xbbfdc9019c1d4def lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777686:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a8082d/0xbbfdc9019c1d4def lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777699:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046a8082d/0xbbfdc9019c1d4def lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777707:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046a8082d/0xbbfdc9019c1d4def lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777722:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265688.777731:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f4ab10c/0xbbfdc9019c1d4df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777738:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4e00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265688.777741:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f4ab10c/0xbbfdc9019c1d4df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777749:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f4ab10c/0xbbfdc9019c1d4df6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777759:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f4ab10c/0xbbfdc9019c1d4df6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777767:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f4ab10c/0xbbfdc9019c1d4df6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.777779:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265688.777781:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265688.777783:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.778310:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265688.778397:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265688.778404:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d7db85/0xbbfdc9019c1d4dfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.778412:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1789265688.778415:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265688.778419:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062d7db85/0xbbfdc9019c1d4dfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.778440:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062d7db85/0xbbfdc9019c1d4dfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.778447:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d7db85/0xbbfdc9019c1d4dfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.778453:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062d7db85/0xbbfdc9019c1d4dfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.778475:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.779143:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.779150:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062d7db85/0xbbfdc9019c1d4dfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.779160:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4200 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.779163:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d7db85/0xbbfdc9019c1d4dfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.779172:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d7db85/0xbbfdc9019c1d4dfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.779186:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062d7db85/0xbbfdc9019c1d4dfd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.779192:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062d7db85/0xbbfdc9019c1d4dfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.779212:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.779213:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.779215:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265688.779315:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265688.779321:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee9c62c2/0xbbfdc9019c1d4e04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.779329:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1789265688.779332:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265688.779337:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee9c62c2/0xbbfdc9019c1d4e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.779346:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee9c62c2/0xbbfdc9019c1d4e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.779353:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee9c62c2/0xbbfdc9019c1d4e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.779373:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee9c62c2/0xbbfdc9019c1d4e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.779394:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.779686:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.779691:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee9c62c2/0xbbfdc9019c1d4e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.779700:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5c00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.779703:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee9c62c2/0xbbfdc9019c1d4e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.779723:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee9c62c2/0xbbfdc9019c1d4e04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.779735:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee9c62c2/0xbbfdc9019c1d4e04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.779742:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee9c62c2/0xbbfdc9019c1d4e04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.779758:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.779760:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.779761:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265688.780352:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265688.780360:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011a1356/0xbbfdc9019c1d4e0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.780370:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1789265688.780372:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265688.780377:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011a1356/0xbbfdc9019c1d4e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.780386:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011a1356/0xbbfdc9019c1d4e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.780394:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011a1356/0xbbfdc9019c1d4e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.780401:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011a1356/0xbbfdc9019c1d4e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.780735:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265688.781885:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265688.781903:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0bb37d4/0xbbfdc9019c1d4e12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.781925:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1789265688.781928:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265688.781933:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0bb37d4/0xbbfdc9019c1d4e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.781954:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0bb37d4/0xbbfdc9019c1d4e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.781963:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0bb37d4/0xbbfdc9019c1d4e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.781970:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0bb37d4/0xbbfdc9019c1d4e12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.789555:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265688.789571:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011a1356/0xbbfdc9019c1d4e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.789585:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5400 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.789591:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011a1356/0xbbfdc9019c1d4e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.789603:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011a1356/0xbbfdc9019c1d4e0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.789624:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011a1356/0xbbfdc9019c1d4e0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.789649:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011a1356/0xbbfdc9019c1d4e0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.789691:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.789695:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0bb37d4/0xbbfdc9019c1d4e12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.789702:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a4000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.789706:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0bb37d4/0xbbfdc9019c1d4e12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.789714:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0bb37d4/0xbbfdc9019c1d4e12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.789725:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0bb37d4/0xbbfdc9019c1d4e12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.789733:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.789734:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.789736:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265688.789899:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789265688.789907:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0bb37d4/0xbbfdc9019c1d4e12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.790029:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265688.790485:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265688.790493:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4e19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.790506:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1789265688.790510:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265688.790516:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.790540:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.790549:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.790557:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4e19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.790613:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265688.793212:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265688.793225:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e108ba6/0xbbfdc9019c1d4e20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.793241:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1789265688.793245:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265688.793251:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e108ba6/0xbbfdc9019c1d4e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.793264:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e108ba6/0xbbfdc9019c1d4e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.793273:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e108ba6/0xbbfdc9019c1d4e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265688.793292:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e108ba6/0xbbfdc9019c1d4e20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.799340:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265688.799355:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4e19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.799369:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5a00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.799383:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4e19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.799394:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4e19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.799416:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4e19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.799423:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c70404c7/0xbbfdc9019c1d4e19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.799448:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.799452:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e108ba6/0xbbfdc9019c1d4e20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.799457:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181b600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.799460:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e108ba6/0xbbfdc9019c1d4e20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.799467:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e108ba6/0xbbfdc9019c1d4e20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.799475:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e108ba6/0xbbfdc9019c1d4e20 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.799482:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.799489:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.799491:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.799633:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265688.799733:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789265688.799741:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e108ba6/0xbbfdc9019c1d4e20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265688.808090:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265688.808105:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027822b48/0xbbfdc9019c1d4e27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.808123:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1789265688.808128:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265688.808134:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027822b48/0xbbfdc9019c1d4e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.808149:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027822b48/0xbbfdc9019c1d4e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.808159:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027822b48/0xbbfdc9019c1d4e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.808168:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027822b48/0xbbfdc9019c1d4e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.808191:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.808840:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.808849:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027822b48/0xbbfdc9019c1d4e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.808873:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fce00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.808878:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027822b48/0xbbfdc9019c1d4e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.808889:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027822b48/0xbbfdc9019c1d4e27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.808907:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027822b48/0xbbfdc9019c1d4e27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.808915:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027822b48/0xbbfdc9019c1d4e27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.808936:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.808937:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.808939:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265688.810165:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265688.810176:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000358b5120/0xbbfdc9019c1d4e2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.810189:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1789265688.810193:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265688.810199:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000358b5120/0xbbfdc9019c1d4e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.810227:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000358b5120/0xbbfdc9019c1d4e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.810236:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000358b5120/0xbbfdc9019c1d4e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.810243:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000358b5120/0xbbfdc9019c1d4e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.810257:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.810759:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.810766:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000358b5120/0xbbfdc9019c1d4e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.810776:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fca00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.810786:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000358b5120/0xbbfdc9019c1d4e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.810795:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000358b5120/0xbbfdc9019c1d4e2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.810812:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000358b5120/0xbbfdc9019c1d4e2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.810821:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000358b5120/0xbbfdc9019c1d4e2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.810840:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.810842:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.810843:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265688.811892:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265688.811904:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4e35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.811917:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1789265688.811921:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265688.811926:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.811938:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.813208:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.813234:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265688.813254:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.813829:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.813836:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.813845:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.813850:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.813874:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4e35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.814737:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4e35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.814758:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000692433ea/0xbbfdc9019c1d4e35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.814786:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.814789:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.814791:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.816603:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.816615:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003591863d/0xbbfdc9019c1d4e3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.816631:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.816636:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.816641:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003591863d/0xbbfdc9019c1d4e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.816654:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003591863d/0xbbfdc9019c1d4e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.816681:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003591863d/0xbbfdc9019c1d4e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.816689:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003591863d/0xbbfdc9019c1d4e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.816707:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.816717:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.816732:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003591863d/0xbbfdc9019c1d4e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.816740:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bda00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.816743:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003591863d/0xbbfdc9019c1d4e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.816751:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003591863d/0xbbfdc9019c1d4e3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.816766:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003591863d/0xbbfdc9019c1d4e3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.816773:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003591863d/0xbbfdc9019c1d4e3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.816788:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.816790:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.816791:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.821409:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.821425:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2044534/0xbbfdc9019c1d4e43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.821442:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.821447:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.821453:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2044534/0xbbfdc9019c1d4e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.821481:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2044534/0xbbfdc9019c1d4e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.821492:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2044534/0xbbfdc9019c1d4e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.821501:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2044534/0xbbfdc9019c1d4e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.821522:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.821534:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.821539:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2044534/0xbbfdc9019c1d4e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.821547:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc400 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.821552:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2044534/0xbbfdc9019c1d4e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.821561:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2044534/0xbbfdc9019c1d4e43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.821577:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2044534/0xbbfdc9019c1d4e43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.821584:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2044534/0xbbfdc9019c1d4e43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.821605:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.821606:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.821608:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.822547:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.822556:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4e4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.822568:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.822572:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.822577:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4e4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.822587:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4e4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.822596:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4e4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.822603:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4e4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.822620:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.822629:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.822634:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4e4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.822653:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.822657:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4e4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.822681:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4e4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.822693:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4e4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.822700:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4e4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.822715:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.822717:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.822718:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.823241:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.823249:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4e51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823259:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.823262:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.823267:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823276:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823291:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823298:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823312:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.823320:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.823324:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823330:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.823334:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823342:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4e51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823354:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4e51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823361:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4e51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823376:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.823382:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.823384:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.823712:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.823718:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4e58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823727:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.823731:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.823734:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823743:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823752:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823758:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823775:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.823782:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.823786:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823792:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd400 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.823795:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823814:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4e58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823825:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4e58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823832:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4e58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.823847:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.823849:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.823850:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.824189:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.824195:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4e5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824204:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.824207:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.824211:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824220:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824228:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824242:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4e5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824256:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.824264:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.824267:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4e5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824274:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.824277:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4e5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824285:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4e5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824297:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4e5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824304:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4e5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824316:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.824318:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.824319:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.824561:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.824574:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036598cb0/0xbbfdc9019c1d4e66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824582:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.824584:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.824588:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036598cb0/0xbbfdc9019c1d4e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824596:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036598cb0/0xbbfdc9019c1d4e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824603:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036598cb0/0xbbfdc9019c1d4e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824610:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036598cb0/0xbbfdc9019c1d4e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824623:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.824631:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.824634:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036598cb0/0xbbfdc9019c1d4e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824641:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167fa00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.824644:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036598cb0/0xbbfdc9019c1d4e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824651:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036598cb0/0xbbfdc9019c1d4e66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824732:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036598cb0/0xbbfdc9019c1d4e66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824739:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036598cb0/0xbbfdc9019c1d4e66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.824754:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.824756:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.824758:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.825267:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.825273:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0585937/0xbbfdc9019c1d4e6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.825282:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.825284:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.825288:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0585937/0xbbfdc9019c1d4e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.825297:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0585937/0xbbfdc9019c1d4e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.825305:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0585937/0xbbfdc9019c1d4e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.825311:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0585937/0xbbfdc9019c1d4e6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.825337:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.825345:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.825349:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0585937/0xbbfdc9019c1d4e6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.825356:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167f200 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.825359:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0585937/0xbbfdc9019c1d4e6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.825368:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0585937/0xbbfdc9019c1d4e6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.825381:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0585937/0xbbfdc9019c1d4e6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.825389:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0585937/0xbbfdc9019c1d4e6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.825403:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.825404:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.825406:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.830446:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.830462:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d03a453/0xbbfdc9019c1d4e74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.830480:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.830493:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.830499:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d03a453/0xbbfdc9019c1d4e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.830514:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d03a453/0xbbfdc9019c1d4e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.830524:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d03a453/0xbbfdc9019c1d4e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.830532:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d03a453/0xbbfdc9019c1d4e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.830550:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.830561:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.830567:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d03a453/0xbbfdc9019c1d4e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.830574:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167e800 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.830578:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d03a453/0xbbfdc9019c1d4e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.830587:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d03a453/0xbbfdc9019c1d4e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.830604:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d03a453/0xbbfdc9019c1d4e74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.830623:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d03a453/0xbbfdc9019c1d4e74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.830642:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.830644:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.830646:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.832489:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.832502:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008b718da/0xbbfdc9019c1d4e7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.832517:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.832521:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.832527:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008b718da/0xbbfdc9019c1d4e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.832539:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008b718da/0xbbfdc9019c1d4e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.832548:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008b718da/0xbbfdc9019c1d4e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.832555:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008b718da/0xbbfdc9019c1d4e7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.832575:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.832585:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.832602:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008b718da/0xbbfdc9019c1d4e7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.832610:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167e000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.832615:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008b718da/0xbbfdc9019c1d4e7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.832623:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008b718da/0xbbfdc9019c1d4e7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.832637:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008b718da/0xbbfdc9019c1d4e7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.832644:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008b718da/0xbbfdc9019c1d4e7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.832676:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.832678:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.832680:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.833218:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.833224:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcafb728/0xbbfdc9019c1d4e82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.833235:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.833238:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.833242:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcafb728/0xbbfdc9019c1d4e82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.833263:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcafb728/0xbbfdc9019c1d4e82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.833272:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcafb728/0xbbfdc9019c1d4e82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.833279:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcafb728/0xbbfdc9019c1d4e82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.833294:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.833302:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.833306:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcafb728/0xbbfdc9019c1d4e82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.833313:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167fc00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.833316:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcafb728/0xbbfdc9019c1d4e82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.833325:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcafb728/0xbbfdc9019c1d4e82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.833335:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcafb728/0xbbfdc9019c1d4e82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.833342:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcafb728/0xbbfdc9019c1d4e82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.833363:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.833364:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.833366:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.834979:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.834990:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4e89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.835005:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.835009:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.835014:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4e89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.835026:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4e89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.835035:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4e89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.835043:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4e89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.835060:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.835069:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.835075:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4e89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.835100:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167e400 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.835104:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4e89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.835113:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4e89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.835129:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4e89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.835136:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4e89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.835154:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.835155:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.835157:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.835998:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.836008:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4e90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.836021:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.836024:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.836029:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4e90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.836039:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4e90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.836055:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4e90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.836063:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4e90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.836081:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.836092:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.836098:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4e90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.836105:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167f600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.836108:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4e90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.836115:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4e90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.836127:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4e90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.836134:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4e90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.836147:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.836155:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.836156:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.840476:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.840489:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4e97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.840506:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.840510:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.840517:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4e97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.840531:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4e97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.840541:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4e97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.840549:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4e97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.840564:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.840576:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.840582:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4e97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.840589:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167f000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.840593:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4e97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.840618:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4e97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.840635:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4e97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.840642:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4e97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.840673:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.840676:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.840678:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265688.841549:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265688.841556:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4e9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.841567:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1789265688.841570:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265688.841575:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4e9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.841584:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4e9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.841591:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4e9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.841609:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4e9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.841624:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265688.841634:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265688.841639:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4e9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.841646:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167e200 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265688.841650:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4e9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.841673:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4e9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.841687:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4e9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.841693:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4e9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265688.841709:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.841711:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265688.841712:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789265688.841754:0:18650:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1789265688.841847:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17168:x1876180579065472:12345-0@lo:5:osp-pre-0-0.0 Request processed in 111774us (111843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265688.841881:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265688.841935:0:17168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1876180579065472:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789265688.843095:0:17168:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1789265688.843148:0:17168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1876180579065600:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789265688.843201:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265688.843226:0:17168:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265688.843261:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579065600 00000100:00100000:1.0:1789265688.843267:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579065600 00000100:00100000:1.0:1789265688.843309:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265688.843317:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17168:x1876180579065600:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789265688.843353:0:18652:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1789265688.862178:0:18646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789265688.862220:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789265688.870185:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17168:x1876180579065600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 26858us (26973us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789265688.870198:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265688.870338:0:17168:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789265688.870347:0:17168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1876180579065600:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789265688.870363:0:17168:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1789265689.273276:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789265689.817241:0:19463:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789265689.817246:0:19463:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789265689.817247:0:19463:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789265689.817551:0:19463:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9377528e4000 00000020:01000004:3.0:1789265689.817582:0:19463:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789265689.817599:0:19463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789265689.817613:0:19463:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93775def4d28) 00000020:00000080:3.0:1789265689.817631:0:19463:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789265690.004597:0:19463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789265690.009794:0:19463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789265690.015820:0:19463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789265690.016737:0:19463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789265690.018252:0:19463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789265690.019700:0:19463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789265690.020322:0:19463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1789265690.041510:0:19463:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789265690.041765:0:19463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789265690.041779:0:19463:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789265690.041791:0:19463:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbbfdc9019c1d4eac 00000020:01000004:3.0:1789265690.041799:0:19463:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789265690.041821:0:19463:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789265690.041824:0:19463:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789265690.041845:0:19463:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789265690.055192:0:19463:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789265690.055206:0:19463:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:1.0:1789265690.099319:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265690.099341:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579065728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265690.099406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265690.099452:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579065728 00000100:00100000:1.0:1789265690.099460:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579065728 00000100:00100000:1.0:1789265690.099508:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265690.099517:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579065728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265690.099556:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789265690.099601:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579065728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265690.099610:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265690.099689:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579065728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265690.100141:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265690.100151:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579065984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265690.100185:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265690.100223:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579065984 00000100:00100000:2.0:1789265690.100227:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579065984 00000100:00100000:2.0:1789265690.100266:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265690.100274:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579065984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265690.100289:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789265690.100322:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579065984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.100328:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789265690.100344:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265690.100378:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579065984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265690.100722:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265690.100735:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579065856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265690.100770:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265690.100800:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579065856 00000100:00100000:0.0:1789265690.100807:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579065856 00000100:00100000:0.0:1789265690.100852:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789265690.100877:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579065856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265690.101173:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789265690.101211:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579065856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 354us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265690.101217:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789265690.101244:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579065856:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1789265690.130611:0:19463:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789265690.130673:0:19463:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.142@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789265690.130678:0:19463:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789265690.130680:0:19463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789265690.130681:0:19463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265690.130682:0:19463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265690.130684:0:19463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265690.130685:0:19463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265690.130686:0:19463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265690.130688:0:19463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265690.130689:0:19463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265690.130693:0:19463:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789265690.130695:0:19463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265690.130696:0:19463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789265690.130697:0:19463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265690.130698:0:19463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265690.130699:0:19463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265690.130700:0:19463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265690.130701:0:19463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265690.130702:0:19463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265690.130703:0:19463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265690.130732:0:19463:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789265690.130753:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579066112:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789265690.130840:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265690.130898:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265690.131307:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579066112 00000100:00100000:2.0:1789265690.131315:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579066112 00000100:00100000:2.0:1789265690.131372:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789265690.131381:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:19463:x1876180579066112:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789265690.131413:0:17138:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789265690.131416:0:17138:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789265690.131420:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789265690.133208:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:19463:x1876180579066112:12345-0@lo:253:mount.lustre.0 Request processed in 1822us (2370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.133220:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789265690.135215:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579066112:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789265690.135235:0:19463:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789265690.135239:0:19463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265690.135241:0:19463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265690.135242:0:19463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265690.135243:0:19463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265690.135244:0:19463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265690.135246:0:19463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265690.135247:0:19463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265690.135250:0:19463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265690.135251:0:19463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789265690.135279:0:19463:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9377528e4000 from lustre-OST0001 10000000:01000000:3.0:1789265690.135311:0:19463:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789265690.135314:0:19463:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789265690.135324:0:19463:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9376433ab370 local copy 00010000:00010000:3.0:1789265690.135335:0:19463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b02 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265690.135460:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579066240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265690.135520:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265690.135560:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775f4a1840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265690.135907:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579066240 00000100:00100000:1.0:1789265690.135915:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579066240 00000100:00100000:1.0:1789265690.135974:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789265690.135985:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:19463:x1876180579066240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265690.136210:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:19463:x1876180579066240:12345-0@lo:501:mount.lustre.0 Request processed in 227us (689us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789265690.136219:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265690.138940:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579066240:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789265690.138972:0:19463:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789265690.139031:0:19463:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789265690.139041:0:19463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b02 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265690.139066:0:19463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bc200/0xbbfdc9019c1d4afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4b02 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265690.139101:0:19463:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9377528e4000 10000000:01000000:3.0:1789265690.139108:0:19463:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789265690.139114:0:19463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789265690.139117:0:19463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265690.139122:0:19463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789265690.139125:0:19463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789265690.139159:0:19463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff93775181b600/0xbbfdc9019c1d4eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265690.139167:0:19463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff93775181b600/0xbbfdc9019c1d4eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265690.139178:0:19463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff93775181b600/0xbbfdc9019c1d4eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265690.139199:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579066368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265690.139255:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265690.139304:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775f4a1840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265690.141430:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579066368 00000100:00100000:1.0:1789265690.141444:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579066368 00000100:00100000:1.0:1789265690.141514:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789265690.141525:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:19463:x1876180579066368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265690.141541:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265690.141559:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93774167e000/0xbbfdc9019c1d4eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4eb3 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265690.141587:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93774167e000/0xbbfdc9019c1d4eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4eb3 expref: 22 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265690.141598:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93774167e000/0xbbfdc9019c1d4eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4eb3 expref: 22 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265690.141607:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93774167e000, rc 0) 00000100:00100000:1.0:1789265690.141709:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:19463:x1876180579066368:12345-0@lo:101:mount.lustre.0 Request processed in 186us (2453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265690.141717:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789265690.141825:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579066368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265690.141856:0:19463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff93775181b600/0xbbfdc9019c1d4eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4eba expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265690.141893:0:19463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff93775181b600/0xbbfdc9019c1d4eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4eba expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265690.152518:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789265690.153454:0:19463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265690.160315:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789265690.160377:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789265690.160410:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789265690.160426:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789265690.160450:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789265690.160465:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789265690.160491:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789265690.160497:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789265690.160612:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579066496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265690.167261:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265690.167320:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377446646c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265690.169254:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579066496 00000100:00100000:2.0:1789265690.169269:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579066496 00000100:00100000:2.0:1789265690.169340:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789265690.169351:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:19463:x1876180579066496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265690.169549:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:19463:x1876180579066496:12345-0@lo:501:mount.lustre.0 Request processed in 199us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.169556:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789265690.171307:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579066496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265690.171370:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579066624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265690.171447:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265690.171495:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377446646c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265690.171629:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579066624 00000100:00100000:3.0:1789265690.171635:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579066624 00000100:00100000:3.0:1789265690.171704:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789265690.171713:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:19463:x1876180579066624:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265690.173404:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:19463:x1876180579066624:12345-0@lo:503:mount.lustre.0 Request processed in 1686us (1949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265690.173415:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789265690.173540:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579066624:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789265690.177409:0:19463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265690.177532:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579066752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265690.177611:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265690.177675:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745123300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265690.178244:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579066752 00000100:00100000:1.0:1789265690.178253:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579066752 00000100:00100000:1.0:1789265690.178309:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789265690.178320:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:19463:x1876180579066752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265690.179259:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:19463:x1876180579066752:12345-0@lo:502:mount.lustre.0 Request processed in 938us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265690.179269:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789265690.179394:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579066752:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265690.179683:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789265690.179715:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789265690.179731:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789265690.179745:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789265690.179759:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789265690.179774:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789265690.179788:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789265690.179801:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789265690.179814:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789265690.179849:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579066880:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265690.180148:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265690.180181:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff937745123300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265690.180265:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579066880 00000100:00100000:2.0:1789265690.180271:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579066880 00000100:00100000:2.0:1789265690.180311:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789265690.180318:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:19463:x1876180579066880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265690.180409:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:19463:x1876180579066880:12345-0@lo:502:mount.lustre.0 Request processed in 90us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.180421:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789265690.180503:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579066880:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265690.180544:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789265690.180552:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789265690.184314:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789265690.184325:0:19467:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789265690.184332:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265690.184334:0:19467:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789265690.184340:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265690.184354:0:19467:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9377475d19b8) 00000020:00000080:2.0:1789265690.184379:0:19467:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789265690.184384:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789265690.184471:0:19467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9377528e4000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789265690.184481:0:19467:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789265690.184489:0:19467:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbbfdc9019c1d4ec8 00010000:00010000:2.0:1789265690.193559:0:19467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789265690.195842:0:19467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1789265690.210626:0:19467:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1789265690.231488:0:19467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789265690.231501:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265690.231507:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265690.231509:0:19467:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789265690.231513:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265690.231516:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265690.231517:0:19467:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789265690.231520:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789265690.231522:0:19467:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789265690.231524:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265690.231526:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265690.231527:0:19467:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789265690.231529:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265690.231531:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265690.231532:0:19467:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789265690.231541:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789265690.231570:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265690.231573:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265690.231575:0:19467:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789265690.231578:0:19467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789265690.253553:0:19463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789265690.253614:0:19463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789265690.253643:0:19463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff93775181b600/0xbbfdc9019c1d4eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4eba expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265690.253671:0:19463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff93775181b600/0xbbfdc9019c1d4eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4eba expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265690.253840:0:19463:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9377528e4000 from 1 10000000:01000000:1.0:1789265690.253845:0:19463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265690.253918:0:19463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265690.253951:0:19463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265690.253963:0:19463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265690.253991:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265690.254073:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265690.254110:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774501e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265690.254344:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579067008 00000100:00100000:0.0:1789265690.254353:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579067008 00000100:00100000:0.0:1789265690.254408:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789265690.254418:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:19463:x1876180579067008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265690.254431:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265690.254444:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937642393c00/0xbbfdc9019c1d4ed6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4ecf expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265690.254479:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642393c00/0xbbfdc9019c1d4ed6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4ecf expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265690.254491:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937642393c00/0xbbfdc9019c1d4ed6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4ecf expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265690.254500:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393c00, rc 0) 00000100:00100000:0.0:1789265690.255489:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:19463:x1876180579067008:12345-0@lo:101:mount.lustre.0 Request processed in 1066us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265690.255499:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789265690.273615:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265690.273664:0:19463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4ed6 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265690.273678:0:19463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4ed6 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265690.288356:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789265690.288636:0:19463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265690.288828:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789265690.288899:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789265690.288918:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789265690.288922:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789265690.289250:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265690.289323:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265690.289371:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774501e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789265690.289437:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579067136 00000100:00100000:2.0:1789265690.289446:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579067136 00000100:00100000:2.0:1789265690.289499:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789265690.289510:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:19463:x1876180579067136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265690.289628:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:19463:x1876180579067136:12345-0@lo:501:mount.lustre.0 Request processed in 119us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.289636:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789265690.289776:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265690.289813:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265690.289883:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265690.289903:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775f6f9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265690.290808:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579067264 00000100:00100000:2.0:1789265690.290817:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579067264 00000100:00100000:2.0:1789265690.290894:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789265690.290902:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:19463:x1876180579067264:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265690.291040:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:19463:x1876180579067264:12345-0@lo:503:mount.lustre.0 Request processed in 137us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.291048:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789265690.291261:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067264:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789265690.291712:0:19463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265690.291793:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265690.291846:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265690.291895:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377446640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265690.292232:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579067392 00000100:00100000:1.0:1789265690.292238:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579067392 00000100:00100000:1.0:1789265690.292278:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789265690.292288:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:19463:x1876180579067392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265690.292387:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:19463:x1876180579067392:12345-0@lo:502:mount.lustre.0 Request processed in 100us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265690.292393:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789265690.298533:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789265690.298837:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789265690.298900:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789265690.298917:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789265690.298943:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789265690.298963:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789265690.298993:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789265690.299614:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789265690.299633:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1789265690.299679:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789265690.299694:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1789265690.299707:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1789265690.299756:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265690.299841:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265690.299916:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774501e840 going to sleep for 11 seconds 00010000:00010000:3.0:1789265690.300363:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265690.303495:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579067520 00000100:00100000:0.0:1789265690.303511:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579067520 00000100:00100000:0.0:1789265690.303584:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789265690.303594:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:19463:x1876180579067520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265690.303810:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:19463:x1876180579067520:12345-0@lo:502:mount.lustre.0 Request processed in 217us (3969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265690.303818:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789265690.306360:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f159f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265690.306482:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789265690.306497:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789265690.317283:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265690.317299:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265690.317302:0:19471:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789265690.317309:0:19471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9377528e4000 00000020:00000080:3.0:1789265690.317313:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265690.317322:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265690.317325:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265690.317326:0:19471:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789265690.317328:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265690.317331:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265690.317332:0:19471:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789265690.317335:0:19471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9377528e4000 00000020:00000080:3.0:1789265690.317336:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265690.317393:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265690.317396:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265690.317412:0:19471:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789265690.317415:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265690.317418:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265690.317420:0:19471:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265690.317423:0:19471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9377528e4000 00000020:00000080:3.0:1789265690.317424:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265690.317444:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265690.317447:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265690.317448:0:19471:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265690.317450:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265690.317452:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265690.317453:0:19471:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789265690.317456:0:19471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9377528e4000 00000020:00000080:3.0:1789265690.317458:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265690.317477:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265690.317481:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265690.317482:0:19471:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789265690.317486:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789265690.317676:0:19463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789265690.317705:0:19463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265690.317728:0:19463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4ed6 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265690.317739:0:19463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4ed6 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265690.317794:0:19463:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789265690.317797:0:19463:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9377528e4000 10000000:01000000:1.0:1789265690.317799:0:19463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9377528e4000 10000000:01000000:1.0:1789265690.317803:0:19463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265690.317809:0:19463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9377528e4000 from 1 10000000:01000000:1.0:1789265690.317811:0:19463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789265690.317850:0:19463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167f200/0xbbfdc9019c1d4edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265690.317889:0:19463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff93774167f200/0xbbfdc9019c1d4edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265690.317902:0:19463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff93774167f200/0xbbfdc9019c1d4edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265690.317940:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265690.318034:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265690.318077:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774501e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265690.329413:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579067648 00000100:00100000:1.0:1789265690.329431:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579067648 00000100:00100000:1.0:1789265690.329494:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789265690.329505:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:19463:x1876180579067648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265690.329523:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265690.329542:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93774167fa00/0xbbfdc9019c1d4ee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4edd expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265690.329574:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93774167fa00/0xbbfdc9019c1d4ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4edd expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265690.329587:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93774167fa00/0xbbfdc9019c1d4ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4edd expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265690.329596:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93774167fa00, rc 0) 00000100:00100000:1.0:1789265690.329692:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:19463:x1876180579067648:12345-0@lo:101:mount.lustre.0 Request processed in 190us (11658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265690.329700:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789265690.329764:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f15b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265690.329784:0:19463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff93774167f200/0xbbfdc9019c1d4edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4ee4 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265690.329794:0:19463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff93774167f200/0xbbfdc9019c1d4edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4ee4 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265690.347156:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1789265690.347490:0:19463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265690.347716:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789265690.347757:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789265690.347772:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789265690.347783:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789265690.347795:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789265690.347808:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789265690.347821:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789265690.347833:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789265690.347844:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789265690.347856:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789265690.347895:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789265690.347908:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789265690.347919:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789265690.347931:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789265690.347944:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789265690.347971:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789265690.347984:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789265690.352541:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789265690.352600:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789265690.352617:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789265690.352632:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789265690.352685:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789265690.352701:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789265690.352714:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789265690.352727:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1789265690.352741:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1789265690.352755:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1789265690.352770:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1789265690.352785:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1789265690.352800:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1789265690.352815:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1789265690.352848:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1789265690.352883:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1789265690.352899:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1789265690.352913:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1789265690.352925:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1789265690.352952:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1789265690.352965:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1789265690.352978:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1789265690.352992:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1789265690.358971:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1789265690.358991:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1789265690.359007:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1789265690.359019:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1789265690.359031:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1789265690.359043:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1789265690.359067:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1789265690.359072:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1789265690.359182:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265690.359251:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265690.359292:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f390d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265690.359580:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579067776 00000100:00100000:1.0:1789265690.359600:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579067776 00000100:00100000:1.0:1789265690.359680:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789265690.359690:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:19463:x1876180579067776:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265690.359808:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:19463:x1876180579067776:12345-0@lo:501:mount.lustre.0 Request processed in 119us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265690.359816:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789265690.362964:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265690.363215:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265690.363287:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265690.363331:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f390d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265690.363587:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579067904 00000100:00100000:2.0:1789265690.363593:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579067904 00000100:00100000:2.0:1789265690.363640:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789265690.363664:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:19463:x1876180579067904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265690.363770:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:19463:x1876180579067904:12345-0@lo:503:mount.lustre.0 Request processed in 107us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.363778:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789265690.366743:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579067904:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789265690.367251:0:19463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265690.367346:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579068032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265690.367413:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265690.367455:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f390d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265690.367649:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579068032 00000100:00100000:2.0:1789265690.367666:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579068032 00000100:00100000:2.0:1789265690.367719:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789265690.367729:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:19463:x1876180579068032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265690.367836:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:19463:x1876180579068032:12345-0@lo:502:mount.lustre.0 Request processed in 109us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.367844:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789265690.370414:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579068032:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789265690.370683:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789265690.370717:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789265690.370733:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789265690.370746:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789265690.370760:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789265690.370772:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789265690.370783:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789265690.370794:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789265690.370807:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789265690.370820:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789265690.370832:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789265690.370843:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789265690.370885:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789265690.370917:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789265690.370965:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789265690.370982:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789265690.371006:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789265690.371019:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789265690.371031:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789265690.371052:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789265690.371063:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789265690.371075:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789265690.371085:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789265690.371097:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789265690.371108:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789265690.371119:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789265690.371131:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789265690.371143:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789265690.371156:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789265690.371184:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789265690.371199:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789265690.371211:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789265690.371222:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789265690.371234:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789265690.371246:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789265690.371256:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789265690.371269:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789265690.371283:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789265690.371295:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789265690.371308:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789265690.371322:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789265690.371337:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789265690.371350:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789265690.371363:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789265690.371375:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789265690.371403:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789265690.371420:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789265690.371434:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789265690.371486:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579068160:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265690.371560:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265690.371605:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579068160 00000100:00100000:0.0:1789265690.371617:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579068160 00000100:00100000:0.0:1789265690.371679:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789265690.371689:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:19463:x1876180579068160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265690.371797:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:19463:x1876180579068160:12345-0@lo:502:mount.lustre.0 Request processed in 110us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265690.371804:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789265690.371848:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f390d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265690.371884:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579068160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789265690.372043:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1789265690.372065:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1789265690.372086:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579068288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265690.372120:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265690.372144:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579068288 00000100:00100000:0.0:1789265690.372148:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579068288 00000100:00100000:0.0:1789265690.372172:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789265690.372178:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937745491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:19463:x1876180579068288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265690.372238:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937745491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:19463:x1876180579068288:12345-0@lo:502:mount.lustre.0 Request processed in 60us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265690.372245:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789265690.372274:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f390d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265690.372285:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579068288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789265690.372318:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1789265690.372325:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789265690.376828:0:19476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789265690.376848:0:19476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9377475d0000) 00000020:00000080:2.0:1789265690.376889:0:19476:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789265690.376985:0:19476:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9377528e4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265690.376990:0:19476:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9377528e4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265690.376992:0:19476:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9377528e4000 3 00010000:00080000:2.0:1789265690.377033:0:19476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93764318f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1789265690.378721:0:19476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789265690.378963:0:19476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789265690.379008:0:19476:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789265690.379021:0:19476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbbfdc9019c1d4ef2 00000100:00080000:2.0:1789265690.379031:0:19476:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265690.379037:0:19476:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93764318f000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1789265690.379075:0:19476:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93777f581c00 x1876180579068416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265690.379123:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180579068416:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789265690.379208:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265690.379277:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579068416 00000100:00100000:2.0:1789265690.379285:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579068416 00000100:00100000:2.0:1789265690.379319:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265690.379327:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876180579068416:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789265690.379364:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:2.0:1789265690.379392:0:17145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbbfdc9019c1d4ef9 00000004:00100000:2.0:1789265690.379407:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789265690.379451:0:17145:0:(import.c:65:import_set_state_nolock()) ffff937642179000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265690.379501:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180579068416:12345-0@lo:38:llog_process_th.0 Request processed in 173us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.379509:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789265690.379549:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f581c00 x1876180579068416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265690.379560:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265690.379568:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789265690.379574:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789265690.379578:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789265690.379580:0:3642:0:(import.c:65:import_set_state_nolock()) ffff93764318f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789265690.379587:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180579068416:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789265690.379606:0:19476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789265690.384437:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265690.384444:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789265690.384456:0:8:0:(import.c:65:import_set_state_nolock()) ffff937760304800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265690.384464:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 544 00000100:00080000:2.0:1789265690.384468:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789265690.384475:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff937760304800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1789265690.384499:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9377507a0000 x1876180579068800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265690.384533:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265690.384535:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789265690.384537:0:8:0:(import.c:65:import_set_state_nolock()) ffff937747e2e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265690.384540:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 544 00000100:00080000:2.0:1789265690.384543:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789265690.384546:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff937747e2e800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1789265690.384555:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9377507a3480 x1876180579069312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265690.384608:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579068544:0@lo:400:kworker.0 00000100:00100000:0.0:1789265690.388328:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579068672:0@lo:400:kworker.0 00000100:00100000:3.0:1789265690.392134:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579069056:0@lo:400:kworker.0 00000100:00100000:1.0:1789265690.399919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265690.399978:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579069440:0@lo:400:kworker.0 00000100:00100000:1.0:1789265690.401509:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265690.401558:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579069440 00000100:00100000:1.0:1789265690.401566:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579069440 00000100:00100000:1.0:1789265690.401621:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789265690.401631:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579069440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265690.401695:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579069440:12345-0@lo:400:kworker.0 Request processed in 66us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265690.401702:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789265690.401743:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9377507a2a00 x1876180579069440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265690.401757:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579069440:0@lo:400:kworker.0 00000100:00100000:1.0:1789265690.401779:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789265690.401788:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579068928:0@lo:400:kworker.0 00000100:00100000:1.0:1789265690.401814:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265690.401844:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180579069568:0@lo:400:kworker.0 00000100:00100000:1.0:1789265690.401906:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265690.401926:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579068928 00000100:00100000:1.0:1789265690.402660:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579068928 00000100:00100000:1.0:1789265690.402705:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579069568 00000100:00100000:1.0:1789265690.402708:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579069568 00000100:00100000:1.0:1789265690.402739:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265690.402747:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579068928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265690.402789:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579068928:12345-0@lo:400:kworker.0 Request processed in 44us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265690.402796:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265690.402810:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789265690.402816:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180579069568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265690.402844:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180579069568:12345-0@lo:400:kworker.0 Request processed in 29us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265690.402850:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1789265690.402914:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9377507a0380 x1876180579069568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265690.402926:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180579069568:0@lo:400:kworker.0 00010000:00080000:1.0:1789265690.403252:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9377507a1880 x1876180579068928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265690.403262:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579068928:0@lo:400:kworker.0 00000100:00100000:2.0:1789265690.403451:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265690.403491:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579068672 00000100:00100000:2.0:1789265690.403495:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579068672 00000100:00100000:2.0:1789265690.403537:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265690.403544:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f15b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579068672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265690.403584:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f15b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579068672:12345-0@lo:400:kworker.0 Request processed in 40us (3673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.403590:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789265690.403617:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265690.403621:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265690.403635:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579068800:0@lo:8:kworker.0 00000100:00100000:2.0:1789265690.403692:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265690.403713:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579069312:0@lo:8:kworker.0 00000100:00100000:2.0:1789265690.403733:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265690.403762:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579068800 00000100:00100000:2.0:1789265690.403765:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579068800 00000100:00100000:2.0:1789265690.403781:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579069312 00000100:00100000:2.0:1789265690.403784:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579069312 00000100:00100000:2.0:1789265690.403796:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265690.403800:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876180579068800:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789265690.403876:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876180579068800:12345-0@lo:8:kworker.0 Request processed in 54us (164us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789265690.403883:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265690.403896:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265690.403900:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876180579069312:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789265690.403941:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876180579069312:12345-0@lo:8:kworker.0 Request processed in 28us (195us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789265690.403947:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265690.403973:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265690.403979:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937760304800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265690.403983:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789265690.403987:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579068800:0@lo:8:kworker.0 00000100:00100000:2.0:1789265690.404119:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789265690.404124:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937747e2e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265690.404127:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789265690.404130:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579069312:0@lo:8:kworker.0 00000100:00100000:2.0:1789265690.404288:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579069184:0@lo:400:kworker.0 00000100:00100000:2.0:1789265690.404318:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265690.404335:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579069184 00000100:00100000:2.0:1789265690.404338:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579069184 00000100:00100000:2.0:1789265690.404359:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265690.404365:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579069184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265690.404393:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579069184:12345-0@lo:400:kworker.0 Request processed in 28us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.404399:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265690.404425:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579069184:0@lo:400:kworker.0 00000100:00100000:1.0:1789265690.408188:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579068544 00000100:00100000:1.0:1789265690.408204:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579068544 00000100:00100000:1.0:1789265690.408273:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789265690.408283:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579068544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265690.408375:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579068544:12345-0@lo:400:kworker.0 Request processed in 94us (4923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265690.408382:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789265690.408449:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579068672:0@lo:400:kworker.0 00000020:01000004:2.0:1789265690.412528:0:19476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789265690.412547:0:19476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9377475d3370) 00000020:00000080:2.0:1789265690.412573:0:19476:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789265690.412664:0:19476:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9377528e4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265690.412669:0:19476:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9377528e4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265690.412672:0:19476:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9377528e4000 3 00010000:00080000:2.0:1789265690.412703:0:19476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93764217f800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.142@tcp at head 00000100:00100000:3.0:1789265690.415369:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265690.415427:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180579069696:0@lo:400:kworker.0 00000100:00100000:3.0:1789265690.415468:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265690.415523:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579069696 00000100:00100000:3.0:1789265690.415530:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579069696 00000100:00100000:3.0:1789265690.415582:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265690.415591:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180579069696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265690.415643:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180579069696:12345-0@lo:400:kworker.0 Request processed in 53us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265690.415664:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789265690.415687:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789265690.415726:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9377507a2680 x1876180579069696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265690.415740:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180579069696:0@lo:400:kworker.0 00000100:00100000:1.0:1789265690.416107:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579069056 00000100:00100000:1.0:1789265690.416112:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579069056 00000100:00100000:1.0:1789265690.416144:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789265690.416151:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579069056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265690.416202:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579069056:12345-0@lo:400:kworker.0 Request processed in 51us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265690.416209:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1789265690.418207:0:19476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1789265690.418408:0:19476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789265690.418454:0:19476:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789265690.418468:0:19476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xbbfdc9019c1d4f07 00000100:00080000:2.0:1789265690.418477:0:19476:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265690.418483:0:19476:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93764217f800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1789265690.418520:0:19476:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9377507a1f80 x1876180579069824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265690.418553:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180579069824:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789265690.418622:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265690.418693:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579069824 00000100:00100000:2.0:1789265690.418706:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579069824 00000100:00100000:2.0:1789265690.420241:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265690.420252:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876180579069824:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789265690.420291:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:2.0:1789265690.420327:0:17145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xbbfdc9019c1d4f0e 00000004:00100000:2.0:1789265690.420346:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789265690.420379:0:17145:0:(import.c:65:import_set_state_nolock()) ffff93764217a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265690.420452:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180579069824:12345-0@lo:38:llog_process_th.0 Request processed in 200us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.420459:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265690.426470:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579069056:0@lo:400:kworker.0 00000100:00100000:3.0:1789265690.426638:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579068544:0@lo:400:kworker.0 00000100:00080000:3.0:1789265690.442606:0:19476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00010000:00080000:3.0:1789265690.442734:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9377507a1f80 x1876180579069824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265690.442749:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265690.442759:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789265690.442767:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789265690.442773:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789265690.442777:0:3642:0:(import.c:65:import_set_state_nolock()) ffff93764217f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789265690.442785:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180579069824:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789265690.464363:0:19476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789265690.464813:0:19463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789265690.464885:0:19463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265690.465174:0:19463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff93774167f200/0xbbfdc9019c1d4edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4ee4 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265690.465187:0:19463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff93774167f200/0xbbfdc9019c1d4edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4ee4 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789265690.465238:0:19463:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789265690.465241:0:19463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789265690.465242:0:19463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265690.465243:0:19463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265690.465245:0:19463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265690.465246:0:19463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265690.465248:0:19463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265690.465250:0:19463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265690.465251:0:19463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265690.465255:0:19463:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789265690.465257:0:19463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265690.465258:0:19463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789265690.465259:0:19463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265690.465260:0:19463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265690.465261:0:19463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265690.465262:0:19463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265690.465263:0:19463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265690.465264:0:19463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265690.465265:0:19463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265690.465290:0:19463:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789265690.465309:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579069952:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789265690.465375:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265690.465412:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9376430c0540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265690.465435:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579069952 00000100:00100000:0.0:1789265690.465441:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579069952 00000100:00100000:0.0:1789265690.465485:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789265690.465494:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937745493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:19463:x1876180579069952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789265690.465522:0:17136:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789265690.465541:0:17136:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789265690.479781:0:17136:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789265690.479800:0:17136:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789265690.480258:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937745493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:19463:x1876180579069952:12345-0@lo:253:mount.lustre.0 Request processed in 14759us (14876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265690.480271:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 20000000:01000000:2.0:1789265690.480511:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789265690.480517:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789265690.480539:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.480555:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937642392400/0xbbfdc9019c1d4dbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4db7 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.480563:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4dcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4dc5 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.480570:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265690.480582:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:19463:1876180579069952:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789265690.480595:0:19463:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789265690.480598:0:19463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265690.480600:0:19463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265690.480601:0:19463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265690.480603:0:19463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265690.480604:0:19463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265690.480605:0:19463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00010000:00010000:2.0:1789265690.480605:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4dcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d4dc5 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789265690.480607:0:19463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265690.480608:0:19463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265690.480610:0:19463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1789265690.480617:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4dcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4dc5 expref: 23 pid: 17138 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1789265690.480625:0:19463:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789265690.480661:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1876180579070080:0@lo:104: 00000100:00100000:2.0:1789265690.480699:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789265690.480734:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937642392400/0xbbfdc9019c1d4dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d4db7 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.480743:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff937642392400/0xbbfdc9019c1d4dbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4db7 expref: 23 pid: 17138 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265690.480751:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1876180579070208:0@lo:104: 00000100:00100000:2.0:1789265690.480772:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265690.480786:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff937760018840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265690.480803:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579070080 00000100:00100000:2.0:1789265690.480808:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579070080 00000100:00100000:2.0:1789265690.480834:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579070208 00000100:00100000:2.0:1789265690.480837:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579070208 00000100:00100000:2.0:1789265690.480850:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265690.480873:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+4:17159:x1876180579070080:12345-0@lo:104: 00010000:00010000:2.0:1789265690.480885:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4dcc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.480928:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265690.480934:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+4:17159:x1876180579070080:12345-0@lo:104: Request processed in 77us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.480940:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265690.480955:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265690.480961:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+3:17159:x1876180579070208:12345-0@lo:104: 00010000:00010000:2.0:1789265690.480968:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4dbe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481019:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265690.481025:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+3:17159:x1876180579070208:12345-0@lo:104: Request processed in 65us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.481032:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265690.481057:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1876180579070080:0@lo:104: 00000100:00100000:2.0:1789265690.481064:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1876180579070208:0@lo:104: 00010000:00010000:2.0:1789265690.481079:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481095:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265690.481100:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4dcc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481108:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5000 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265690.481112:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d4dcc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481120:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d4dcc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265690.481126:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d4dcc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265690.481133:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265690.481156:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4dcc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481162:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265690.481186:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4dcc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481193:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377465a5000/0xbbfdc9019c1d4dc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4dcc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481205:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265690.481209:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4dbe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481214:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bce00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:2.0:1789265690.481217:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d4dbe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481223:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d4dbe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265690.481229:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d4dbe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265690.481234:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265690.481247:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4dbe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481253:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265690.481276:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4dbe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481282:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377532bce00/0xbbfdc9019c1d4db7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4dbe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481305:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265690.481307:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265690.481308:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265690.481315:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265690.481328:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265690.481340:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3646:1876180579070464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265690.481368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265690.481405:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579070464 00000100:00100000:2.0:1789265690.481409:0:17898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579070464 00010000:00010000:2.0:1789265690.481424:0:17898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937642392400/0xbbfdc9019c1d4dbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4db7 expref: 24 pid: 17138 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265690.481446:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265690.481452:0:17898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:3646:x1876180579070464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265690.481462:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265690.481467:0:17898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937642392400/0xbbfdc9019c1d4dbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4db7 expref: 24 pid: 17138 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481476:0:17898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937642392400/0xbbfdc9019c1d4dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4db7 expref: 24 pid: 17138 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481488:0:17898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937642392400/0xbbfdc9019c1d4dbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d4db7 expref: 24 pid: 17138 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481498:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265690.481525:0:17898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:3646:x1876180579070464:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.481532:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265690.481567:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3646:1876180579070464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265690.481593:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265690.481603:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579070336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265690.481628:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265690.481671:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579070336 00000100:00100000:2.0:1789265690.481675:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579070336 00010000:00010000:2.0:1789265690.481688:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4dcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4dc5 expref: 23 pid: 17138 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265690.481707:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265690.481712:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:3643:x1876180579070336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265690.481720:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265690.481724:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4dcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4dc5 expref: 23 pid: 17138 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481733:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4dcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4dc5 expref: 23 pid: 17138 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481742:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bc800/0xbbfdc9019c1d4dcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d4dc5 expref: 23 pid: 17138 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481757:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481765:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265690.481777:0:17131:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012514975s 00010000:00010000:2.0:1789265690.481782:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481799:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481805:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481811:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481816:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fce00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:2.0:1789265690.481821:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481829:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481841:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481850:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265690.481902:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:3643:x1876180579070336:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265690.481909:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789265690.481930:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481938:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265690.481944:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9376435fce00/0xbbfdc9019c1d4f15 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265690.481978:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579070336:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789265690.494337:0:19463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789265690.497628:0:19463:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789265690.497638:0:19463:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789265690.497694:0:19463:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789265690.497739:0:19463:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789265690.497760:0:19463:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789265690.497782:0:19463:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789265690.507613:0:19463:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265690.511419:0:19463:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265691.318206:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265691.344439:0:19529:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265691.345009:0:19529:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1789265691.767810:0:17141:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265691.767817:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93775f5f4800 from 10 10000000:01000000:0.0:1789265691.767823:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265691.767893:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392600/0xbbfdc9019c1d4f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265691.767905:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642392600/0xbbfdc9019c1d4f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265691.767916:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642392600/0xbbfdc9019c1d4f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265691.767942:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579070592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265691.768009:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265691.768051:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9376430c0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265691.768230:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579070592 00000100:00100000:3.0:1789265691.768245:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579070592 00000100:00100000:3.0:1789265691.768305:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789265691.768314:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937745490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:17141:x1876180579070592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265691.768332:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265691.768345:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93775181be00/0xbbfdc9019c1d4f23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4f1c expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265691.768368:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93775181be00/0xbbfdc9019c1d4f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4f1c expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265691.768378:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93775181be00/0xbbfdc9019c1d4f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4f1c expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265691.768387:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93775181be00, rc 0) 00000100:00100000:3.0:1789265691.768429:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937745490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:17141:x1876180579070592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265691.768436:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789265691.768494:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579070592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265691.768510:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642392600/0xbbfdc9019c1d4f1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4f23 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265691.768518:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642392600/0xbbfdc9019c1d4f1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4f23 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265691.768567:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579070720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789265691.768597:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265691.768616:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265691.769788:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579070720 00000100:00100000:0.0:1789265691.769797:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579070720 00000100:00100000:0.0:1789265691.769846:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789265691.769855:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937745493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:17141:x1876180579070720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789265691.769897:0:17137:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789265691.769917:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789265691.769924:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789265691.770019:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937745493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:17141:x1876180579070720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 165us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265691.770027:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789265691.770779:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579070720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789265691.770854:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789265691.770896:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392600/0xbbfdc9019c1d4f1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4f23 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265691.770908:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642392600/0xbbfdc9019c1d4f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4f23 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265691.770918:0:17141:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789265691.770920:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93777f58d800 from 10 10000000:01000000:3.0:1789265691.770923:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789265691.770947:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff93775181a800/0xbbfdc9019c1d4f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265691.770955:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff93775181a800/0xbbfdc9019c1d4f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265691.770964:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff93775181a800/0xbbfdc9019c1d4f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265691.770981:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579070848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265691.771017:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265691.771045:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265691.771115:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579070848 00000100:00100000:0.0:1789265691.771120:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579070848 00000100:00100000:0.0:1789265691.771162:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789265691.771169:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937745493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:17141:x1876180579070848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265691.771180:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265691.771191:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d4f2a expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265691.771217:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4f2a expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265691.771228:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937642393000/0xbbfdc9019c1d4f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4f2a expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265691.771237:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393000, rc 0) 00000100:00100000:0.0:1789265691.771271:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937745493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:17141:x1876180579070848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265691.771277:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789265691.771554:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579070848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265691.771566:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff93775181a800/0xbbfdc9019c1d4f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4f31 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265691.771574:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff93775181a800/0xbbfdc9019c1d4f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d4f31 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265691.771622:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579070976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789265691.771666:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265691.771689:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff937744d62480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265691.771794:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579070976 00000100:00100000:0.0:1789265691.771799:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579070976 00000100:00100000:0.0:1789265691.771830:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789265691.771836:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937745491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:17141:x1876180579070976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789265691.771848:0:17138:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789265691.771888:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789265691.771891:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789265691.771957:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937745491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:17141:x1876180579070976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265691.771963:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789265691.772057:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579070976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789265691.772095:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789265691.772100:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff93775181a800/0xbbfdc9019c1d4f2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4f31 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265691.772108:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff93775181a800/0xbbfdc9019c1d4f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d4f31 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265691.955502:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789265692.344558:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265693.366299:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265694.197266:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579071104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265694.197334:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265694.197392:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579071104 00000100:00100000:1.0:1789265694.197399:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579071104 00000100:00080000:3.0:1789265694.197931:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265694.197986:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265694.197997:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579071104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265694.198028:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789265694.198080:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579071104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265694.198087:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265694.198206:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579071104:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789265694.389966:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265695.221984:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579071232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265695.222058:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265695.222940:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579071232 00000100:00100000:1.0:1789265695.222958:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579071232 00000100:00100000:0.0:1789265695.222981:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265695.222992:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579071360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265695.223006:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789265695.223014:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579071232:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265695.223028:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1789265695.223047:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789265695.223099:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579071232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265695.223106:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789265695.223121:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579071360 00000100:00100000:1.0:1789265695.223124:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579071360 00000100:00100000:1.0:1789265695.223138:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789265695.223138:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774e40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579071232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265695.223143:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579071360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265695.223159:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789265695.223208:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579071360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265695.223214:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789265695.223569:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376434d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579071360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265695.223817:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579071488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265695.223901:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.224723:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579071488 00000100:00100000:0.0:1789265695.224730:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579071488 00000100:00100000:0.0:1789265695.224787:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265695.224796:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579071488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265695.224813:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789265695.224856:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579071488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265695.224880:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789265695.224936:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265695.226795:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579071488:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789265695.414600:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265695.679143:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1789265695.731165:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265695.731172:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789265695.731175:0:8:0:(import.c:65:import_set_state_nolock()) ffff937760304800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265695.731186:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff937760304800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265695.731207:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937642666a00 x1876180579072000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265695.731257:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265695.731260:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789265695.731262:0:8:0:(import.c:65:import_set_state_nolock()) ffff937747e2e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265695.731267:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff937747e2e800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1789265695.731278:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937642664380 x1876180579072512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265695.731334:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579071744:0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.731411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.731886:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579072384:0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.731915:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.731932:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180579073024:0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.731960:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.731985:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789265695.731992:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579071872:0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.732012:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.732027:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180579072640:0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.732046:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.732061:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180579073152:0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.732080:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.732104:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579072000:0@lo:8:kworker.0 00000100:00100000:0.0:1789265695.732126:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.732139:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579072512:0@lo:8:kworker.0 00000100:00100000:0.0:1789265695.732157:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.732198:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579071744 00000100:00100000:0.0:1789265695.732205:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579071744 00000100:00100000:0.0:1789265695.732254:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265695.732264:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579071744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.732317:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579071744:12345-0@lo:400:kworker.0 Request processed in 55us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265695.732324:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789265695.732347:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579073024 00000100:00100000:0.0:1789265695.732350:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579073024 00000100:00100000:0.0:1789265695.732378:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579072640 00000100:00100000:0.0:1789265695.732381:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579072640 00000100:00100000:0.0:1789265695.732396:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579073152 00000100:00100000:0.0:1789265695.732398:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579073152 00000100:00100000:0.0:1789265695.732412:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265695.732551:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180579073024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.732588:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180579073024:12345-0@lo:400:kworker.0 Request processed in 169us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265695.732595:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265695.732621:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265695.732627:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376434d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180579072640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.732655:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376434d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180579072640:12345-0@lo:400:kworker.0 Request processed in 29us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265695.732661:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265695.732671:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265695.732677:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180579073152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.732703:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180579073152:12345-0@lo:400:kworker.0 Request processed in 26us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265695.732787:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789265695.732830:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642667480 x1876180579072640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265695.732844:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180579072640:0@lo:400:kworker.0 00010000:00080000:0.0:1789265695.732855:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642665c00 x1876180579073152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265695.732883:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180579073152:0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.732894:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579071744:0@lo:400:kworker.0 00010000:00080000:0.0:1789265695.732905:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642667800 x1876180579073024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265695.732911:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180579073024:0@lo:400:kworker.0 00000100:00100000:2.0:1789265695.733018:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3646:1876180579071616:0@lo:400:kworker.0 00000100:00100000:2.0:1789265695.733053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265695.733086:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579072256:0@lo:400:kworker.0 00000100:00100000:2.0:1789265695.733110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265695.733129:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180579072896:0@lo:400:kworker.0 00000100:00100000:2.0:1789265695.733153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265695.733173:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789265695.733179:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180579072128:0@lo:400:kworker.0 00000100:00100000:2.0:1789265695.733198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265695.733215:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180579072768:0@lo:400:kworker.0 00000100:00100000:2.0:1789265695.733233:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265695.733265:0:19187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579072384 00000100:00100000:2.0:1789265695.733269:0:19187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579072384 00000100:00100000:2.0:1789265695.733290:0:19187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579071872 00000100:00100000:2.0:1789265695.733292:0:19187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579071872 00000100:00100000:2.0:1789265695.733305:0:19187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579072000 00000100:00100000:2.0:1789265695.733307:0:19187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579072000 00000100:00100000:2.0:1789265695.733315:0:19187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579072512 00000100:00100000:2.0:1789265695.733318:0:19187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579072512 00000100:00100000:2.0:1789265695.733326:0:19187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265695.733333:0:19187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579072384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265695.733367:0:19187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579072384:12345-0@lo:400:kworker.0 Request processed in 35us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265695.733374:0:19187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265695.733385:0:19187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265695.733391:0:19187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579071872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.733562:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579071616 00000100:00100000:0.0:1789265695.733567:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579071616 00000100:00100000:0.0:1789265695.733595:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789265695.733611:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:3646:x1876180579071616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.733658:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:3646:x1876180579071616:12345-0@lo:400:kworker.0 Request processed in 57us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265695.733665:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789265695.733699:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3646:1876180579071616:0@lo:400:kworker.0 00000100:00100000:2.0:1789265695.733778:0:19187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579071872:12345-0@lo:400:kworker.0 Request processed in 27us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265695.733787:0:19187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265695.733800:0:19187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265695.733804:0:19187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1876180579072000:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789265695.733828:0:19187:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:2.0:1789265695.733856:0:19187:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbbfdc9019c1d4f38 00002000:00100000:2.0:1789265695.733893:0:19187:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93764217d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789265695.733898:0:19187:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789265695.733901:0:19187:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789265695.734063:0:19187:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789265695.734083:0:19187:0:(import.c:65:import_set_state_nolock()) ffff93764217d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265695.734122:0:19187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180579072000:12345-0@lo:8:kworker.0 Request processed in 316us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265695.734135:0:19187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265695.734147:0:19187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265695.734151:0:19187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1876180579072512:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789265695.734167:0:19187:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:2.0:1789265695.734182:0:19187:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbbfdc9019c1d4f3f 00002000:00100000:2.0:1789265695.734189:0:19187:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff93764217b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789265695.734192:0:19187:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789265695.734194:0:19187:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789265695.734214:0:19187:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789265695.734226:0:19187:0:(import.c:65:import_set_state_nolock()) ffff93764217a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265695.734254:0:19187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3642:x1876180579072512:12345-0@lo:8:kworker.0 Request processed in 101us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265695.734260:0:19187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265695.734281:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579072896 00000100:00100000:2.0:1789265695.734285:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579072896 00000100:00100000:2.0:1789265695.734304:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579072128 00000100:00100000:2.0:1789265695.734306:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579072128 00000100:00100000:2.0:1789265695.734316:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579072768 00000100:00100000:2.0:1789265695.734318:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579072768 00000100:00100000:2.0:1789265695.734331:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265695.734338:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180579072896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265695.734367:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876180579072896:12345-0@lo:400:kworker.0 Request processed in 29us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265695.734373:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265695.734384:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265695.734389:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180579072128:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789265695.734578:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642667100 x1876180579072896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265695.734589:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876180579072896:0@lo:400:kworker.0 00010000:00080000:0.0:1789265695.734634:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642666a00 x1876180579072000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789265695.734645:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789265695.734653:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789265695.734658:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789265695.734661:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937760304800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789265695.734675:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789265695.734680:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876180579072000:0@lo:8:kworker.0 00000004:00080000:3.0:1789265695.734993:0:17169:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789265695.735052:0:17169:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 551396191697ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789265695.735058:0:17169:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:0.0:1789265695.735252:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642664380 x1876180579072512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789265695.735263:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789265695.735268:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789265695.735271:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789265695.735274:0:3642:0:(import.c:65:import_set_state_nolock()) ffff937747e2e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789265695.735282:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789265695.735286:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876180579072512:0@lo:8:kworker.0 00000004:00080000:0.0:1789265695.735334:0:17170:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1789265695.735351:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f476300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1876180579073408:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789265695.735385:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.735406:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9376430c0180 going to sleep for 11 seconds 00000100:00100000:2.0:1789265695.735701:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180579072128:12345-0@lo:400:kworker.0 Request processed in 1310us (2500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265695.735776:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265695.735796:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265695.735805:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180579072768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265695.735840:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180579072768:12345-0@lo:400:kworker.0 Request processed in 37us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265695.735846:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265695.735879:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579073408 00000100:00100000:2.0:1789265695.735884:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579073408 00000100:00100000:2.0:1789265695.735914:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265695.735920:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17170:x1876180579073408:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789265695.736248:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579073280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265695.736279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.736312:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579073280 00000100:00100000:0.0:1789265695.736315:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579073280 00000100:00100000:0.0:1789265695.736344:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265695.736359:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876180579073280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265695.736374:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265695.736409:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876180579073280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265695.736415:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:3.0:1789265695.736644:0:17888:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789265695.736660:0:17888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1876180579073664:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789265695.736689:0:17888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265695.736719:0:17888:0:(client.c:2715:ptlrpc_set_wait()) set ffff93775f4a1780 going to sleep for 11 seconds 00000004:00080000:3.0:1789265695.736732:0:17887:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789265695.736790:0:17887:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 551397929696ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789265695.736795:0:17887:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:0.0:1789265695.737311:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f477100 x1876180579073280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265695.737329:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579073280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265695.737343:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265695.737349:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579073536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265695.737373:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.737409:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579071872:0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.738299:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579072384:0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.738402:0:19187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579073664 00000100:00100000:0.0:1789265695.738407:0:19187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579073664 00000100:00100000:3.0:1789265695.738971:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579073536 00000100:00100000:3.0:1789265695.738976:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579073536 00000100:00100000:0.0:1789265695.739045:0:19187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789265695.739569:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265695.743005:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265695.743020:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1876180579073536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265695.743044:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789265695.743123:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1876180579073536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (5750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265695.743130:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789265695.743176:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2fd180 x1876180579073536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265695.743195:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579073536:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1789265695.744680:0:17124:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789265695.744920:0:17877:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789265695.745207:0:19187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17888:x1876180579073664:12345-0@lo:7:osp-pre-1-1.0 00010000:00080000:0.0:1789265695.745294:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642665880 x1876180579072128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265695.745309:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180579072128:0@lo:400:kworker.0 00010000:00080000:0.0:1789265695.745324:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937642667b80 x1876180579072768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265695.745333:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180579072768:0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.745839:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579072256 00000100:00100000:0.0:1789265695.745847:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579072256 00000100:00100000:0.0:1789265695.745905:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789265695.745914:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579072256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265695.745981:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579072256:12345-0@lo:400:kworker.0 Request processed in 69us (12870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265695.745988:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789265695.746026:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579072256:0@lo:400:kworker.0 00000100:00080000:2.0:1789265695.746194:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265695.746198:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:2.0:1789265695.747120:0:18651:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789265695.747128:0:18651:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789265695.747133:0:18651:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:0.0:1789265695.750636:0:19187:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789265695.750645:0:19187:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789265695.750745:0:19187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17888:x1876180579073664:12345-0@lo:7:osp-pre-1-1.0 Request processed in 11687us (14050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265695.750755:0:19187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789265695.750814:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93774f2ff100 x1876180579073664/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265711 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265695.750828:0:17888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1876180579073664:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789265695.750841:0:17888:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789265695.750912:0:17888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f474380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1876180579073792:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789265695.750948:0:17888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.750971:0:17888:0:(client.c:2715:ptlrpc_set_wait()) set ffff9376430c0b40 going to sleep for 11 seconds 00002000:00010000:2.0:1789265695.765811:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265695.765823:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027822b48/0xbbfdc9019c1d4f46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.765840:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1789265695.765845:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265695.765852:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027822b48/0xbbfdc9019c1d4f46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265695.765962:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579073792 00000100:00100000:1.0:1789265695.765972:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579073792 00000100:00100000:1.0:1789265695.766025:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789265695.766035:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17888:x1876180579073792:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789265695.766066:0:18650:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789265695.766148:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17888:x1876180579073792:12345-0@lo:5:osp-pre-1-1.0 Request processed in 114us (15199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265695.766155:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789265695.766199:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f474380 x1876180579073792/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265711 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265695.766213:0:17888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f474380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1876180579073792:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789265695.766227:0:17888:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789265695.766269:0:17888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1876180579073920:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789265695.766301:0:17888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265695.766323:0:17888:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377660db780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265695.766337:0:19187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579073920 00000100:00100000:1.0:1789265695.766340:0:19187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579073920 00000100:00100000:1.0:1789265695.766361:0:19187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265695.766368:0:19187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17888:x1876180579073920:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789265695.766401:0:19187:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00010000:2.0:1789265695.766817:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027822b48/0xbbfdc9019c1d4f46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.766827:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027822b48/0xbbfdc9019c1d4f46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.766835:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027822b48/0xbbfdc9019c1d4f46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.766877:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265695.767659:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265695.767666:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000358b5120/0xbbfdc9019c1d4f4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.767677:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1789265695.767680:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265695.767684:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000358b5120/0xbbfdc9019c1d4f4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.767693:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000358b5120/0xbbfdc9019c1d4f4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.767701:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000358b5120/0xbbfdc9019c1d4f4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.767806:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265695.767814:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027822b48/0xbbfdc9019c1d4f46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.767821:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fce00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265695.767825:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027822b48/0xbbfdc9019c1d4f46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.767842:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027822b48/0xbbfdc9019c1d4f46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.767876:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027822b48/0xbbfdc9019c1d4f46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.767885:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027822b48/0xbbfdc9019c1d4f46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.767907:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.767908:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.767910:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265695.767963:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000358b5120/0xbbfdc9019c1d4f4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.769808:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265695.771784:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265695.771798:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000692433ea/0xbbfdc9019c1d4f54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.771816:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1789265695.771820:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265695.771826:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000692433ea/0xbbfdc9019c1d4f54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.771840:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000692433ea/0xbbfdc9019c1d4f54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.771851:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000692433ea/0xbbfdc9019c1d4f54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.771879:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000692433ea/0xbbfdc9019c1d4f54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.775280:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265695.775292:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000358b5120/0xbbfdc9019c1d4f4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.775306:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fca00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265695.775311:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000358b5120/0xbbfdc9019c1d4f4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.775322:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000358b5120/0xbbfdc9019c1d4f4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.775342:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000358b5120/0xbbfdc9019c1d4f4d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.775361:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000358b5120/0xbbfdc9019c1d4f4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.775385:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265695.775389:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000692433ea/0xbbfdc9019c1d4f54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.775395:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fd600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265695.775398:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000692433ea/0xbbfdc9019c1d4f54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.775406:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000692433ea/0xbbfdc9019c1d4f54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.775415:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000692433ea/0xbbfdc9019c1d4f54 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.775423:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.775425:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.775427:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265695.775783:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789265695.775791:0:18651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000692433ea/0xbbfdc9019c1d4f54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265695.777552:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265695.777561:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bff17774/0xbbfdc9019c1d4f5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.777577:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1789265695.777581:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265695.777587:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff17774/0xbbfdc9019c1d4f5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.777664:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff17774/0xbbfdc9019c1d4f5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.777675:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bff17774/0xbbfdc9019c1d4f5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.777682:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bff17774/0xbbfdc9019c1d4f5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.777701:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265695.777990:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265695.777997:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bff17774/0xbbfdc9019c1d4f5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.778006:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937782163e00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265695.778016:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bff17774/0xbbfdc9019c1d4f5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.778026:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bff17774/0xbbfdc9019c1d4f5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.778041:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bff17774/0xbbfdc9019c1d4f5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.778049:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff17774/0xbbfdc9019c1d4f5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.778068:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.778070:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.778071:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265695.778313:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265695.778998:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265695.779005:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4865a7d/0xbbfdc9019c1d4f62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.779016:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1789265695.779026:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265695.779031:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4865a7d/0xbbfdc9019c1d4f62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.779043:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4865a7d/0xbbfdc9019c1d4f62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.779051:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4865a7d/0xbbfdc9019c1d4f62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.779058:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4865a7d/0xbbfdc9019c1d4f62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.780651:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265695.781358:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265695.781368:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092a46423/0xbbfdc9019c1d4f69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.781384:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1789265695.781388:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265695.781394:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092a46423/0xbbfdc9019c1d4f69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.781406:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092a46423/0xbbfdc9019c1d4f69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.781416:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092a46423/0xbbfdc9019c1d4f69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.781430:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092a46423/0xbbfdc9019c1d4f69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.783895:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265695.783909:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4865a7d/0xbbfdc9019c1d4f62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.783922:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937782163600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265695.783927:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4865a7d/0xbbfdc9019c1d4f62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.783938:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4865a7d/0xbbfdc9019c1d4f62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.783958:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4865a7d/0xbbfdc9019c1d4f62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.783976:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4865a7d/0xbbfdc9019c1d4f62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.783994:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265695.783998:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092a46423/0xbbfdc9019c1d4f69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.784004:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937782162a00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265695.784007:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092a46423/0xbbfdc9019c1d4f69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.784015:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092a46423/0xbbfdc9019c1d4f69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.784026:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092a46423/0xbbfdc9019c1d4f69 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.784034:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.784036:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.784038:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265695.784161:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789265695.784168:0:18651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092a46423/0xbbfdc9019c1d4f69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265695.784806:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265695.784815:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013202482/0xbbfdc9019c1d4f70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.784827:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789265695.784832:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265695.784839:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013202482/0xbbfdc9019c1d4f70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.784853:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013202482/0xbbfdc9019c1d4f70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.785111:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013202482/0xbbfdc9019c1d4f70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.785118:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013202482/0xbbfdc9019c1d4f70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.785138:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265695.785400:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265695.785406:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013202482/0xbbfdc9019c1d4f70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.785414:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181a600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265695.785423:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013202482/0xbbfdc9019c1d4f70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.785432:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013202482/0xbbfdc9019c1d4f70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.785445:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013202482/0xbbfdc9019c1d4f70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.785451:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013202482/0xbbfdc9019c1d4f70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.785466:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.785468:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.785470:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265695.785544:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265695.785551:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000508c9661/0xbbfdc9019c1d4f77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.785559:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789265695.785562:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265695.785567:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000508c9661/0xbbfdc9019c1d4f77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.785576:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000508c9661/0xbbfdc9019c1d4f77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.785584:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000508c9661/0xbbfdc9019c1d4f77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.785590:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000508c9661/0xbbfdc9019c1d4f77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265695.785689:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.785828:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265695.794928:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265695.794943:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000508c9661/0xbbfdc9019c1d4f77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.794959:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181ae00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265695.794963:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000508c9661/0xbbfdc9019c1d4f77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.794973:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000508c9661/0xbbfdc9019c1d4f77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.794994:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000508c9661/0xbbfdc9019c1d4f77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.795008:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000508c9661/0xbbfdc9019c1d4f77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.795031:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.795033:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.795034:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265695.800978:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265695.800991:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4f7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.801008:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789265695.801014:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265695.801020:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4f7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.801034:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4f7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.801043:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4f7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.801051:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4f7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.801073:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265695.801082:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265695.801087:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4f7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.801095:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181ac00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265695.801105:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4f7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.801115:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4f7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.801129:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4f7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.801136:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4f7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.801150:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.801152:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.801153:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265695.801978:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265695.801986:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f0d0460/0xbbfdc9019c1d4f85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.801996:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789265695.801999:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265695.802003:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f0d0460/0xbbfdc9019c1d4f85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.802013:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f0d0460/0xbbfdc9019c1d4f85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.802020:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f0d0460/0xbbfdc9019c1d4f85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.802034:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f0d0460/0xbbfdc9019c1d4f85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.802055:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265695.802701:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265695.802775:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f0d0460/0xbbfdc9019c1d4f85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.802785:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181b800 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265695.802788:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f0d0460/0xbbfdc9019c1d4f85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.802797:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f0d0460/0xbbfdc9019c1d4f85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.802811:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f0d0460/0xbbfdc9019c1d4f85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.802819:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f0d0460/0xbbfdc9019c1d4f85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.802833:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.802835:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.802837:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265695.805979:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265695.805994:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4f8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.806013:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789265695.806017:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265695.806022:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4f8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.806036:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4f8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.806047:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4f8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.806056:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4f8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.806074:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265695.806085:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265695.806091:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4f8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.806110:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181a000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265695.806115:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4f8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.806125:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4f8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.806143:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4f8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.806152:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4f8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.806172:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.806175:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.806177:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265695.810288:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265695.810301:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4f93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.810317:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789265695.810321:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265695.810328:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4f93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.810343:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4f93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.810353:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4f93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.810360:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4f93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.810379:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789265695.810774:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265695.810781:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4f9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.810789:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789265695.810792:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265695.810795:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4f9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.810810:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4f9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.810818:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4f9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.810824:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4f9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.810847:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789265695.811161:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265695.811169:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4f93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.811178:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167e200 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265695.811182:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4f93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.811192:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4f93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.811209:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4f93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.811217:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f6f7393/0xbbfdc9019c1d4f93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.811236:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265695.811239:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4f9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.811244:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167f000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265695.811247:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4f9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.811254:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4f9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.811275:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4f9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.811281:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9042ca5/0xbbfdc9019c1d4f9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.811293:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.811295:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.811297:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789265695.811535:0:19464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789265695.811556:0:19464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789265695.811561:0:19464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1789265695.811843:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265695.811850:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4fa1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.811874:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789265695.811878:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265695.811883:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4fa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.811893:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4fa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.811901:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4fa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.811921:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4fa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.811940:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265695.812797:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265695.812805:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4fa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.812813:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167f600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265695.812817:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4fa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.812825:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4fa1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.812839:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4fa1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.812873:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000448bcc97/0xbbfdc9019c1d4fa1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265695.812891:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.812893:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.812895:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265695.812967:0:19187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17888:x1876180579073920:12345-0@lo:5:osp-pre-1-1.0 Request processed in 46595us (46661us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789265695.812977:0:19187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265695.813025:0:17888:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789265695.813033:0:17888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1876180579073920:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789265695.813047:0:17888:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789265695.813092:0:17888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f474700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17888:1876180579074048:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789265695.813125:0:17888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.813148:0:17888:0:(client.c:2715:ptlrpc_set_wait()) set ffff9376430c0540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265695.813169:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579074048 00000100:00100000:0.0:1789265695.813175:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579074048 00000100:00100000:0.0:1789265695.813212:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265695.813223:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17888:x1876180579074048:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789265695.813268:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17888:x1876180579074048:12345-0@lo:900:osp-pre-1-1.0 Request processed in 48us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265695.813274:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789265695.813305:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f474700 x1876180579074048/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265711 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265695.813328:0:17888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f474700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17888:1876180579074048:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1789265695.813464:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265695.813470:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4fa8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.813480:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789265695.813484:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265695.813488:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4fa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.813498:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4fa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.813506:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4fa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.813513:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4fa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.813533:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265695.813727:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265695.813733:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4fa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.813742:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167e400 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265695.813745:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4fa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.813753:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4fa8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.813771:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4fa8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.813778:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ec2f1d4/0xbbfdc9019c1d4fa8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.813795:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.813796:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.813798:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265695.815256:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265695.815359:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265695.815368:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001566ff1f/0xbbfdc9019c1d4faf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.815387:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789265695.815391:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265695.815396:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001566ff1f/0xbbfdc9019c1d4faf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.815406:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001566ff1f/0xbbfdc9019c1d4faf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.815415:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001566ff1f/0xbbfdc9019c1d4faf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.815422:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001566ff1f/0xbbfdc9019c1d4faf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.815442:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265695.815744:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265695.815750:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001566ff1f/0xbbfdc9019c1d4faf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.815759:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc800 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265695.815763:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001566ff1f/0xbbfdc9019c1d4faf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.815773:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001566ff1f/0xbbfdc9019c1d4faf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.815788:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001566ff1f/0xbbfdc9019c1d4faf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.815795:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001566ff1f/0xbbfdc9019c1d4faf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.815823:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.815825:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.815826:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265695.816802:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265695.816810:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bc94344/0xbbfdc9019c1d4fb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.816821:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789265695.816824:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265695.816829:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bc94344/0xbbfdc9019c1d4fb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.816839:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bc94344/0xbbfdc9019c1d4fb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.817653:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bc94344/0xbbfdc9019c1d4fb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.817666:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bc94344/0xbbfdc9019c1d4fb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.817692:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265695.817999:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265695.818006:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bc94344/0xbbfdc9019c1d4fb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.818015:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bce00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265695.818019:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bc94344/0xbbfdc9019c1d4fb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.818028:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bc94344/0xbbfdc9019c1d4fb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.818042:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bc94344/0xbbfdc9019c1d4fb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.818049:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bc94344/0xbbfdc9019c1d4fb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.818069:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.818070:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.818072:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265695.818697:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265695.818715:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4fbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.818726:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789265695.818730:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265695.818736:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4fbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.818746:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4fbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.818755:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4fbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.818761:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4fbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.818805:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265695.819028:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265695.819034:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4fbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.819053:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd600 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265695.819056:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4fbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.819065:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4fbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.819079:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4fbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.819086:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eea1e0a/0xbbfdc9019c1d4fbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.819100:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.819102:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.819103:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265695.821448:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265695.821461:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4fc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.821477:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789265695.821481:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265695.821488:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4fc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.821502:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4fc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.821517:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4fc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.821526:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4fc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.821553:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265695.823025:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265695.823034:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098bb1314/0xbbfdc9019c1d4fcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823047:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789265695.823051:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265695.823055:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098bb1314/0xbbfdc9019c1d4fcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823066:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098bb1314/0xbbfdc9019c1d4fcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823076:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098bb1314/0xbbfdc9019c1d4fcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823083:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098bb1314/0xbbfdc9019c1d4fcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823110:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789265695.823120:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265695.823126:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4fc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823133:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181ac00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265695.823137:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4fc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823147:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823162:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4fc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823170:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cc535d9/0xbbfdc9019c1d4fc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823188:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265695.823191:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098bb1314/0xbbfdc9019c1d4fcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823196:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181b000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265695.823200:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098bb1314/0xbbfdc9019c1d4fcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823217:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098bb1314/0xbbfdc9019c1d4fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823227:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098bb1314/0xbbfdc9019c1d4fcb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823233:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098bb1314/0xbbfdc9019c1d4fcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823244:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.823245:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.823246:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265695.823632:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265695.823806:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265695.823814:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092b1f4c7/0xbbfdc9019c1d4fd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823821:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789265695.823824:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265695.823828:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b1f4c7/0xbbfdc9019c1d4fd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823836:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092b1f4c7/0xbbfdc9019c1d4fd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823844:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092b1f4c7/0xbbfdc9019c1d4fd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823912:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092b1f4c7/0xbbfdc9019c1d4fd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.823960:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265695.826561:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265695.826573:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4fd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.826587:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789265695.826591:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265695.826613:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4fd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.826626:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4fd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.826634:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4fd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.826643:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4fd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.828173:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265695.828186:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092b1f4c7/0xbbfdc9019c1d4fd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.828196:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181bc00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265695.828201:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092b1f4c7/0xbbfdc9019c1d4fd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.828210:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092b1f4c7/0xbbfdc9019c1d4fd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.828229:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092b1f4c7/0xbbfdc9019c1d4fd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.828237:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092b1f4c7/0xbbfdc9019c1d4fd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.828255:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265695.828258:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4fd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.828264:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181a000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265695.828267:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4fd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.828284:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4fd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.828295:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4fd9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.828302:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265695.828303:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265695.828305:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.828392:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789265695.828398:0:18651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000769f76ab/0xbbfdc9019c1d4fd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265695.828954:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265695.828960:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d4fe0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.828970:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789265695.828974:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265695.828979:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d4fe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.828989:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d4fe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.828997:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d4fe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.829003:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d4fe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.829016:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265695.829267:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265695.829273:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d4fe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.829281:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181b400 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265695.829284:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d4fe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.829292:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d4fe0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.829304:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d4fe0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.829311:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d4fe0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.829337:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265695.829339:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265695.829341:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265695.829347:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265695.829475:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265695.829482:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4fe7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.829490:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789265695.829494:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265695.829498:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4fe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.829507:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4fe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.829515:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4fe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.829521:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4fe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.829541:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265695.829882:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265695.829887:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4fe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.829895:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd400 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265695.829898:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4fe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.829911:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4fe7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.829922:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4fe7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.829929:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c335c2e/0xbbfdc9019c1d4fe7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.829942:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.829944:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.829945:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265695.830067:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265695.830072:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4fee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.830088:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789265695.830091:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265695.830095:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4fee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.830103:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4fee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.830110:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4fee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.830116:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4fee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.830135:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789265695.830356:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265695.830361:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4ff5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.830368:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789265695.830371:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265695.830374:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4ff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.830383:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4ff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.830399:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4ff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.830405:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4ff5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.830415:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789265695.830624:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265695.830630:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4fee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.830637:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265695.830641:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4fee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.830649:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4fee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.830661:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4fee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.830677:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034a94fbf/0xbbfdc9019c1d4fee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.830691:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265695.830694:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4ff5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.830700:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265695.830703:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4ff5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.830816:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4ff5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.830827:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4ff5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.830833:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b760e6f6/0xbbfdc9019c1d4ff5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.830846:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.830848:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.830850:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.830856:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265695.830960:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265695.830966:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2044534/0xbbfdc9019c1d4ffc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.830974:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789265695.830977:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265695.830981:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2044534/0xbbfdc9019c1d4ffc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.830990:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2044534/0xbbfdc9019c1d4ffc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.830998:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2044534/0xbbfdc9019c1d4ffc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.831005:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2044534/0xbbfdc9019c1d4ffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265695.831236:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789265695.831279:0:18651:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1789265695.831390:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17170:x1876180579073408:12345-0@lo:5:osp-pre-1-0.0 Request processed in 95466us (96000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265695.831401:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265695.831491:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f476300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1876180579073408:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789265695.831508:0:17170:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1789265695.831554:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f476300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1876180579074176:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789265695.831587:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265695.831632:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9376430c0180 going to sleep for 11 seconds 00000100:00100000:1.0:1789265695.836904:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579074176 00000100:00100000:1.0:1789265695.836920:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579074176 00000100:00100000:1.0:1789265695.836982:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265695.836992:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17170:x1876180579074176:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789265695.837037:0:18652:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:3.0:1789265695.841775:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265695.841788:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2044534/0xbbfdc9019c1d4ffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.841807:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc400 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265695.841812:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2044534/0xbbfdc9019c1d4ffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.841824:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2044534/0xbbfdc9019c1d4ffc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.841844:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2044534/0xbbfdc9019c1d4ffc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.841852:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2044534/0xbbfdc9019c1d4ffc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265695.841912:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.841914:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265695.841916:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265695.843265:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17170:x1876180579074176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6271us (11673us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789265695.843276:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265695.843478:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f476300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1876180579074176:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789265695.843494:0:17170:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1789265696.436162:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265697.388298:0:19819:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789265697.459620:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265698.483067:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265698.682111:0:19871:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265698.682354:0:19871:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789265699.315249:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579074304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265699.315320:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265699.315490:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579074304 00000100:00100000:1.0:1789265699.315498:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579074304 00000100:00080000:0.0:1789265699.315715:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265699.315758:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265699.315768:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579074304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265699.315798:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789265699.315881:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579074304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265699.315888:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265699.317132:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579074304:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789265699.507061:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265699.687699:0:19921:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265699.688547:0:19921:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789265699.948101:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265699.948215:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556959616 00000100:00100000:1.0:1789265699.948226:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556959616 00000100:00100000:1.0:1789265699.948275:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 118 00000100:00100000:1.0:1789265699.948283:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2396:x1876180556959616:12345-192.168.202.42@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789265699.948326:0:17137:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ba7beb9c-943e-4381-81e6-43a0a05c3424@192.168.202.42@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:1.0:1789265699.948357:0:17137:0:(genops.c:1385:class_connect()) connect: client ba7beb9c-943e-4381-81e6-43a0a05c3424, cookie 0xbbfdc9019c1d5003 00000100:00080000:1.0:1789265699.948514:0:17137:0:(import.c:65:import_set_state_nolock()) ffff937642516000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265699.948596:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+5:2396:x1876180556959616:12345-192.168.202.42@tcp:250:mount.lustre.0 Request processed in 312us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265699.948604:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 118 00000100:00100000:3.0:1789265699.955943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265699.956036:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556959744 00000100:00100000:0.0:1789265699.956046:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556959744 00000100:00100000:0.0:1789265699.956109:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 119 00000100:00100000:0.0:1789265699.956121:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+5:14904:x1876180556959744:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789265699.956137:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265699.956157:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937642393a00/0xbbfdc9019c1d500a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919518 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265699.956187:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642393a00/0xbbfdc9019c1d500a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919518 expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265699.956199:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937642393a00/0xbbfdc9019c1d500a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919518 expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265699.956222:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642393a00, rc 0) 00000100:00100000:0.0:1789265699.956283:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+6:14904:x1876180556959744:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 165us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265699.956291:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 119 00000100:00100000:2.0:1789265699.959642:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265699.959800:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556959872 00000100:00100000:0.0:1789265699.959810:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556959872 00000100:00100000:0.0:1789265699.959899:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 120 00000100:00100000:0.0:1789265699.959910:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+6:14904:x1876180556959872:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789265699.960028:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+6:14904:x1876180556959872:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 120us (395us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265699.960036:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 120 00000100:00100000:2.0:1789265699.963915:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265699.964079:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556960000 00000100:00100000:1.0:1789265699.964092:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556960000 00000100:00100000:1.0:1789265699.964191:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 121 00000100:00100000:1.0:1789265699.964202:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+6:14904:x1876180556960000:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789265699.964217:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265699.964235:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d5011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91951f expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265699.964262:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d5011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91951f expref: 7 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265699.964273:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bd400/0xbbfdc9019c1d5011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91951f expref: 7 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265699.964282:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bd400, rc 0) 00000100:00100000:1.0:1789265699.964377:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+7:14904:x1876180556960000:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 177us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265699.964385:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 121 00000100:00100000:3.0:1789265699.967084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265699.967775:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556960128 00000100:00100000:2.0:1789265699.967786:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556960128 00000100:00100000:2.0:1789265699.967947:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 122 00000100:00100000:2.0:1789265699.967958:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+7:14904:x1876180556960128:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789265699.968120:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+8:14904:x1876180556960128:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 164us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265699.968128:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 122 00000100:00100000:2.0:1789265699.975776:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265699.975897:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556960256 00000100:00100000:3.0:1789265699.975920:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556960256 00000100:00100000:3.0:1789265699.975967:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 123 00000100:00100000:3.0:1789265699.975977:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+8:14904:x1876180556960256:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789265699.976109:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+8:14904:x1876180556960256:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 133us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265699.976118:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 123 00000100:00100000:3.0:1789265699.989544:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265699.991395:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556960384 00000100:00100000:1.0:1789265699.991412:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556960384 00000100:00100000:2.0:1789265699.991639:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 124 00000100:00100000:2.0:1789265699.991650:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+8:14922:x1876180556960384:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265699.991825:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+8:14922:x1876180556960384:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 176us (2287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265699.991833:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 124 00000100:00100000:1.0:1789265700.008798:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265700.009030:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556960512 00000100:00100000:0.0:1789265700.009042:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556960512 00000100:00100000:0.0:1789265700.009103:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 125 00000100:00100000:0.0:1789265700.009114:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+8:14922:x1876180556960512:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265700.009313:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+8:14922:x1876180556960512:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 201us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265700.009321:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 125 00000100:00100000:1.0:1789265700.017033:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265700.017684:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556960640 00000100:00100000:2.0:1789265700.017698:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556960640 00000100:00100000:2.0:1789265700.017775:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 126 00000100:00100000:2.0:1789265700.017785:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+8:14922:x1876180556960640:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265700.017976:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+8:14922:x1876180556960640:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 192us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265700.017984:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 126 00000100:00100000:2.0:1789265700.053394:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265700.053504:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556960768 00000100:00100000:3.0:1789265700.053514:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556960768 00000100:00100000:3.0:1789265700.053572:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 127 00000100:00100000:3.0:1789265700.053582:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+8:14904:x1876180556960768:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789265700.053600:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265700.053619:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93775181a000/0xbbfdc9019c1d5018 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919550 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265700.053651:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93775181a000/0xbbfdc9019c1d5018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919550 expref: 9 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265700.053664:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93775181a000/0xbbfdc9019c1d5018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919550 expref: 9 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265700.053674:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93775181a000, rc 0) 00000100:00100000:3.0:1789265700.053740:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+9:14904:x1876180556960768:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 159us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265700.053747:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 127 00000100:00100000:1.0:1789265700.061790:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265700.061905:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556960896 00000100:00100000:2.0:1789265700.061916:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556960896 00000100:00100000:2.0:1789265700.061973:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 128 00000100:00100000:2.0:1789265700.061984:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+9:14904:x1876180556960896:12345-192.168.202.42@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789265700.062021:0:17137:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789265700.062044:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789265700.062047:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789265700.062049:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789265700.062051:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789265700.062052:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1789265700.064728:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+9:14904:x1876180556960896:12345-192.168.202.42@tcp:256:mount.lustre.0 Request processed in 2734us (2936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265700.064743:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 128 00000100:00100000:0.0:1789265700.074753:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265700.075059:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556961024 00000100:00100000:1.0:1789265700.075070:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556961024 00000100:00100000:1.0:1789265700.075129:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 129 00000100:00100000:1.0:1789265700.075139:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+9:14904:x1876180556961024:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789265700.075156:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265700.075175:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bc400/0xbbfdc9019c1d501f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919557 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265700.075200:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bc400/0xbbfdc9019c1d501f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919557 expref: 10 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265700.075211:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bc400/0xbbfdc9019c1d501f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919557 expref: 10 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265700.075220:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc400, rc 0) 00000100:00100000:1.0:1789265700.075282:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+10:14904:x1876180556961024:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 145us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265700.075289:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 129 00000100:00100000:1.0:1789265700.082583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265700.084524:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556961152 00000100:00100000:2.0:1789265700.084539:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556961152 00000100:00100000:2.0:1789265700.084632:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 130 00000100:00100000:2.0:1789265700.084642:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+10:14904:x1876180556961152:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789265700.084931:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+10:14904:x1876180556961152:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 290us (2366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265700.084940:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 130 00000100:00100000:2.0:1789265700.103800:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265700.104041:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556961280 00000100:00100000:3.0:1789265700.104051:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556961280 00000100:00100000:3.0:1789265700.104120:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 131 00000100:00100000:3.0:1789265700.104130:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+10:14904:x1876180556961280:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789265700.104275:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+10:14904:x1876180556961280:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 145us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265700.104282:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 131 00000100:00100000:0.0:1789265700.110045:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265700.110392:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556961408 00000100:00100000:1.0:1789265700.110402:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556961408 00000100:00100000:1.0:1789265700.110476:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 132 00000100:00100000:1.0:1789265700.110487:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+10:14926:x1876180556961408:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265700.110665:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+10:14926:x1876180556961408:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 179us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265700.110683:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 132 00000100:00100000:1.0:1789265700.127796:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265700.129123:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556961536 00000100:00100000:2.0:1789265700.129137:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556961536 00000100:00100000:2.0:1789265700.129202:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 133 00000100:00100000:2.0:1789265700.129212:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+10:14926:x1876180556961536:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265700.129375:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+10:14926:x1876180556961536:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 164us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265700.129383:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 133 00000100:00100000:2.0:1789265700.142747:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265700.143027:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265700.143250:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556961664 00000100:00100000:1.0:1789265700.143262:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556961664 00000100:00100000:1.0:1789265700.143312:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556961920 00000100:00100000:1.0:1789265700.143315:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556961920 00000100:00100000:1.0:1789265700.143328:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:1.0:1789265700.143336:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876180556961664:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789265700.143365:0:17143:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 296b6286-1162-4204-a595-38172c479be3@192.168.202.42@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:1.0:1789265700.143429:0:17143:0:(genops.c:1385:class_connect()) connect: client 296b6286-1162-4204-a595-38172c479be3, cookie 0xbbfdc9019c1d5026 00000004:00100000:1.0:1789265700.143452:0:17143:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1789265700.143843:0:17143:0:(import.c:65:import_set_state_nolock()) ffff937642514800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265700.144108:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+6:2396:x1876180556961664:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 770us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265700.144117:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:1.0:1789265700.144137:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:1.0:1789265700.144142:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876180556961920:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789265700.144158:0:17143:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 296b6286-1162-4204-a595-38172c479be3@192.168.202.42@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:1.0:1789265700.144206:0:17143:0:(genops.c:1385:class_connect()) connect: client 296b6286-1162-4204-a595-38172c479be3, cookie 0xbbfdc9019c1d502d 00000004:00100000:1.0:1789265700.144219:0:17143:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1789265700.144339:0:17143:0:(import.c:65:import_set_state_nolock()) ffff937642510800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265700.144361:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+6:2396:x1876180556961920:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 218us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265700.144368:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:0.0:1789265700.170612:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265700.170657:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265700.170805:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556962048 00000100:00100000:2.0:1789265700.170815:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556962048 00000100:00100000:2.0:1789265700.170915:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556961792 00000100:00100000:2.0:1789265700.170920:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556961792 00000100:00100000:2.0:1789265700.170944:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:2.0:1789265700.170954:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+6:0:x1876180556962048:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789265700.170998:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789265700.171084:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+6:0:x1876180556962048:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 131us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265700.171091:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:2.0:1789265700.171108:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:2.0:1789265700.171129:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+6:0:x1876180556961792:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789265700.171147:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789265700.171185:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+6:0:x1876180556961792:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 57us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265700.171191:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00080000:0.0:1789265700.171996:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265700.172002:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265700.177625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265700.179574:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556962176 00000100:00100000:2.0:1789265700.179588:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556962176 00000100:00100000:2.0:1789265700.179664:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:2.0:1789265700.179675:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+6:14904:x1876180556962176:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789265700.179709:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789265700.180796:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+6:14904:x1876180556962176:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 1105us (3162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265700.180806:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:2.0:1789265700.189187:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265700.189308:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556962304 00000100:00100000:1.0:1789265700.189329:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556962304 00000100:00100000:1.0:1789265700.189424:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:1.0:1789265700.189436:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+6:14904:x1876180556962304:12345-192.168.202.42@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789265700.189528:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+6:14904:x1876180556962304:12345-192.168.202.42@tcp:40:mount.lustre.0 Request processed in 95us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265700.189535:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:0.0:1789265700.193384:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265700.193433:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265700.193506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265700.193616:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556962688 00000100:00100000:2.0:1789265700.193626:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556962688 00000100:00100000:2.0:1789265700.193688:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:2.0:1789265700.193699:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:296b6286-1162-4204-a595-38172c479be3+6:14904:x1876180556962688:12345-192.168.202.42@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789265700.193777:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:296b6286-1162-4204-a595-38172c479be3+6:14904:x1876180556962688:12345-192.168.202.42@tcp:900:mount.lustre.0 Request processed in 80us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265700.193801:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:3.0:1789265700.194592:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556962432 00000100:00100000:3.0:1789265700.194600:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556962432 00000100:00100000:3.0:1789265700.194634:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556962560 00000100:00100000:3.0:1789265700.194637:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556962560 00000100:00100000:3.0:1789265700.194665:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:3.0:1789265700.194671:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1876180556962432:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789265700.194702:0:18651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 296b6286-1162-4204-a595-38172c479be3@192.168.202.42@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:3.0:1789265700.194730:0:18651:0:(genops.c:1385:class_connect()) connect: client 296b6286-1162-4204-a595-38172c479be3, cookie 0xbbfdc9019c1d5034 00002000:00100000:3.0:1789265700.194741:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 296b6286-1162-4204-a595-38172c479be3/ffff937643e2a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789265700.194752:0:18651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:0.0:1789265700.195759:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:0.0:1789265700.195768:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2396:x1876180556962560:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789265700.195813:0:18650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 296b6286-1162-4204-a595-38172c479be3@192.168.202.42@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:0.0:1789265700.195843:0:18650:0:(genops.c:1385:class_connect()) connect: client 296b6286-1162-4204-a595-38172c479be3, cookie 0xbbfdc9019c1d503b 00002000:00100000:0.0:1789265700.195850:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 296b6286-1162-4204-a595-38172c479be3/ffff937751849800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789265700.195892:0:18650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789265700.196045:0:18650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789265700.196074:0:18650:0:(import.c:65:import_set_state_nolock()) ffff93775184f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265700.196132:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:296b6286-1162-4204-a595-38172c479be3+6:2396:x1876180556962560:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 363us (2626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265700.196140:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00002000:00080000:3.0:1789265700.196773:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789265700.197763:0:18651:0:(import.c:65:import_set_state_nolock()) ffff937643e28000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265700.198987:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:296b6286-1162-4204-a595-38172c479be3+6:2396:x1876180556962432:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 4307us (5546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265700.198998:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:2.0:1789265700.216533:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265700.217204:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556962816 00000100:00100000:1.0:1789265700.217219:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556962816 00000100:00100000:1.0:1789265700.217328:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:1.0:1789265700.217341:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:296b6286-1162-4204-a595-38172c479be3+6:14904:x1876180556962816:12345-192.168.202.42@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789265700.222501:0:17146:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4980us 00000004:00200000:2.0:1789265700.234539:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789265700.234747:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:296b6286-1162-4204-a595-38172c479be3+6:14904:x1876180556962816:12345-192.168.202.42@tcp:33:mount.lustre.0 Request processed in 17401us (18230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265700.234778:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:2.0:1789265700.339511:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579074432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265700.339620:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265700.339883:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579074432 00000100:00100000:1.0:1789265700.339895:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579074432 00000100:00100000:1.0:1789265700.339990:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265700.340003:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579074432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265700.340042:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789265700.340117:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579074432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265700.340125:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265700.340190:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579074432:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789265700.341032:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265700.341097:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579074560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265700.341161:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265700.341316:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579074560 00000100:00100000:1.0:1789265700.341323:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579074560 00000100:00100000:1.0:1789265700.341366:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789265700.341375:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579074560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265700.341411:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789265700.341461:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579074560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265700.341494:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789265700.341805:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579074560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265700.341974:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265700.341983:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579074688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265700.342015:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265700.342179:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579074688 00000100:00100000:3.0:1789265700.342184:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579074688 00000100:00100000:3.0:1789265700.342210:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789265700.342217:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579074688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265700.342247:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265700.342292:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579074688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265700.342299:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789265700.342401:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579074688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265700.418199:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265700.418566:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556962944 00000100:00100000:2.0:1789265700.418580:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556962944 00000100:00100000:2.0:1789265700.418658:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:2.0:1789265700.418670:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+6:14949:x1876180556962944:12345-192.168.202.42@tcp:101:mkdir.0 00010000:00010000:2.0:1789265700.418697:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265700.418732:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937782162800/0xbbfdc9019c1d5042 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919588 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265700.419169:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937782162a00/0xbbfdc9019c1d5049 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265700.419183:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937782162a00/0xbbfdc9019c1d5049 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265700.419197:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937782162a00/0xbbfdc9019c1d5049 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265700.419258:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789265700.419279:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265700.419330:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937782162a00/0xbbfdc9019c1d5049 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265700.419359:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937782162800/0xbbfdc9019c1d5042 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919588 expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265700.419378:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937782162a00/0xbbfdc9019c1d5049 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919588 expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265700.419387:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93775de3d300) 00010000:00010000:2.0:1789265700.419390:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265700.419394:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937782162a00, rc 0) 00000100:00100000:2.0:1789265700.419488:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+7:14949:x1876180556962944:12345-192.168.202.42@tcp:101:mkdir.0 Request processed in 819us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265700.419497:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00010000:00010000:3.0:1789265700.531173:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265700.851602:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579074816:0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.851728:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265700.851796:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579075328:0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.851830:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265700.851889:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789265700.851896:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579074944:0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.851921:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265700.851937:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579075456:0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.851981:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265700.852029:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579075328 00000100:00100000:0.0:1789265700.852038:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579075328 00000100:00100000:0.0:1789265700.852095:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579074944 00000100:00100000:0.0:1789265700.852098:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579074944 00000100:00100000:0.0:1789265700.852110:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579075456 00000100:00100000:0.0:1789265700.852113:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579075456 00000100:00100000:0.0:1789265700.852137:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265700.852147:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579075328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.852214:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579075328:12345-0@lo:400:kworker.0 Request processed in 69us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265700.852223:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265700.852243:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265700.852250:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579074944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.852279:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579074944:12345-0@lo:400:kworker.0 Request processed in 31us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265700.852285:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265700.852296:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265700.852303:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579075456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.852329:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579075456:12345-0@lo:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265700.852335:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265700.852378:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579074944:0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.852389:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579075456:0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.852398:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579075328:0@lo:400:kworker.0 00000100:00100000:3.0:1789265700.852452:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579074816 00000100:00100000:0.0:1789265700.852454:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180579075200:0@lo:400:kworker.0 00000100:00100000:3.0:1789265700.852456:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579074816 00000100:00100000:3.0:1789265700.852487:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789265700.852494:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:3643:x1876180579074816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.852499:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265700.852521:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579075712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265700.852531:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:3643:x1876180579074816:12345-0@lo:400:kworker.0 Request processed in 38us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265700.852537:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789265700.852542:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265700.852583:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789265700.852587:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579074816:0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.852590:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f37ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579075072:0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.852612:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265700.852616:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579075200 00000100:00100000:3.0:1789265700.852620:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579075200 00000100:00100000:0.0:1789265700.852629:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93774f2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579075584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265700.852648:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265700.852664:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789265700.852669:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579075072 00000100:00100000:3.0:1789265700.852671:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180579075200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.852672:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579075072 00000100:00100000:0.0:1789265700.852695:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265700.852701:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876180579075072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265700.852705:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876180579075200:12345-0@lo:400:kworker.0 Request processed in 36us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265700.852712:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789265700.852735:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876180579075072:12345-0@lo:400:kworker.0 Request processed in 35us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265700.852742:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265700.852766:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579075712 00000100:00100000:0.0:1789265700.852770:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579075712 00000100:00100000:0.0:1789265700.852785:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579075584 00000100:00100000:0.0:1789265700.852787:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579075584 00000100:00100000:0.0:1789265700.852797:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265700.852803:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579075712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265700.852820:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265700.852850:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579075712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265700.852856:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265700.852889:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265700.852896:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876180579075584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265700.852913:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265700.852936:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876180579075584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265700.852943:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265700.853000:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579075072:0@lo:400:kworker.0 00000100:00100000:3.0:1789265700.853016:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579075584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265700.853029:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876180579075200:0@lo:400:kworker.0 00000100:00100000:3.0:1789265700.853039:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93774f2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579075712:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789265700.853393:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265700.855086:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180579076096:0@lo:400:kworker.0 00000100:00100000:3.0:1789265700.855094:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876180579076224:0@lo:400:kworker.0 00000100:00100000:2.0:1789265700.860472:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180579075968:0@lo:400:kworker.0 00000100:00100000:3.0:1789265700.862100:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265700.862294:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180579075840:0@lo:400:kworker.0 00000100:00100000:3.0:1789265700.862333:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265700.862456:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180579076352:0@lo:400:kworker.0 00000100:00100000:3.0:1789265700.862481:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265700.862501:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579076224 00000100:00100000:1.0:1789265700.862512:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579076224 00000100:00100000:1.0:1789265700.862602:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579075840 00000100:00100000:1.0:1789265700.862606:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579075840 00000100:00100000:1.0:1789265700.862625:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265700.862635:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876180579076224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265700.862707:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876180579076224:12345-0@lo:400:kworker.0 Request processed in 72us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265700.862715:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789265700.862734:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789265700.862740:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180579075840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265700.862772:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180579075840:12345-0@lo:400:kworker.0 Request processed in 32us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265700.862778:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1789265700.863143:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265700.863313:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180579075840:0@lo:400:kworker.0 00000100:00100000:3.0:1789265700.863360:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876180579076224:0@lo:400:kworker.0 00000100:00100000:1.0:1789265700.863438:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579076352 00000100:00100000:1.0:1789265700.863444:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579076352 00000100:00100000:1.0:1789265700.863494:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789265700.863502:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180579076352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265700.863547:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180579076352:12345-0@lo:400:kworker.0 Request processed in 46us (1065us total) trans 0 rc 0/0 00000100:00080000:3.0:1789265700.863635:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789265700.863658:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f3e0000 x1876180579076352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265700.863660:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265700.863670:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180579076352:0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.863700:0:17143:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789265700.863711:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789265700.863711:0:17143:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789265700.863727:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579076096 00000100:00100000:1.0:1789265700.863730:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579076096 00000100:00100000:1.0:1789265700.863759:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789265700.863764:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265700.863765:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180579076096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265700.864397:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180579076096:12345-0@lo:400:kworker.0 Request processed in 629us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265700.864405:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1789265700.864490:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f3e1c00 x1876180579076096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265700.864501:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180579076096:0@lo:400:kworker.0 00000100:00100000:2.0:1789265700.865267:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265700.865458:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579075968 00000100:00100000:0.0:1789265700.865468:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579075968 00000100:00100000:0.0:1789265700.865541:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789265700.865563:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180579075968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265700.865630:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876180579075968:12345-0@lo:400:kworker.0 Request processed in 81us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265700.865638:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789265700.865729:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265700.866335:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180579075968:0@lo:400:kworker.0 00000040:00080000:2.0:1789265701.173001:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1789265701.379982:0:19464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 296b6286-1162-4204-a595-38172c479be3 00000001:00080000:2.0:1789265701.380005:0:19464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:3.0:1789265701.555014:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265702.242476:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265702.242844:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556963072 00000100:00100000:1.0:1789265702.242988:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556963072 00000100:00100000:1.0:1789265702.243067:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:1.0:1789265702.243079:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+7:15001:x1876180556963072:12345-192.168.202.42@tcp:41:lfs.0 00000004:00000024:1.0:1789265702.243139:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789265702.243228:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+7:15001:x1876180556963072:12345-192.168.202.42@tcp:41:lfs.0 Request processed in 152us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265702.243236:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00080000:0.0:1789265702.243497:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265702.253286:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265702.255352:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556963200 00000100:00100000:2.0:1789265702.255366:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556963200 00000100:00100000:2.0:1789265702.255522:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:2.0:1789265702.255557:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+6:15001:x1876180556963200:12345-192.168.202.42@tcp:41:lfs.0 00000004:00000024:2.0:1789265702.255615:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789265702.255728:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+6:15001:x1876180556963200:12345-192.168.202.42@tcp:41:lfs.0 Request processed in 196us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265702.255735:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00080000:0.0:1789265702.260696:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265702.266500:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265702.267204:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556963328 00000100:00100000:0.0:1789265702.267217:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556963328 00000100:00100000:0.0:1789265702.267302:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:0.0:1789265702.267317:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:296b6286-1162-4204-a595-38172c479be3+6:15001:x1876180556963328:12345-192.168.202.42@tcp:13:lfs.0 00002000:00000024:0.0:1789265702.267342:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789265702.267422:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:296b6286-1162-4204-a595-38172c479be3+6:15001:x1876180556963328:12345-192.168.202.42@tcp:13:lfs.0 Request processed in 109us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265702.267445:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00080000:3.0:1789265702.268502:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265702.270139:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265702.270305:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556963456 00000100:00100000:0.0:1789265702.270315:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556963456 00000100:00100000:0.0:1789265702.270393:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:0.0:1789265702.270405:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f2fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:296b6286-1162-4204-a595-38172c479be3+5:15001:x1876180556963456:12345-192.168.202.42@tcp:13:lfs.0 00002000:00000024:0.0:1789265702.270438:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265702.270522:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f2fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:296b6286-1162-4204-a595-38172c479be3+5:15001:x1876180556963456:12345-192.168.202.42@tcp:13:lfs.0 Request processed in 120us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265702.270530:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00080000:3.0:1789265702.271096:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789265702.579087:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265702.585347:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265702.585515:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556963584 00000100:00100000:2.0:1789265702.585526:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556963584 00000100:00100000:2.0:1789265702.585601:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 135 00000100:00100000:2.0:1789265702.585612:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+10:15035:x1876180556963584:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789265702.585628:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265702.585646:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937782162800/0xbbfdc9019c1d5050 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91958f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265702.585675:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937782162800/0xbbfdc9019c1d5050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91958f expref: 11 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265702.585687:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937782162800/0xbbfdc9019c1d5050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91958f expref: 11 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265702.585696:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937782162800, rc 0) 00000100:00100000:2.0:1789265702.585770:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+11:15035:x1876180556963584:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 160us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265702.585776:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 135 00000100:00100000:1.0:1789265702.593172:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265702.593283:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556963712 00000100:00100000:2.0:1789265702.593294:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556963712 00000100:00100000:2.0:1789265702.593399:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 136 00000100:00100000:2.0:1789265702.593411:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+11:15035:x1876180556963712:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789265702.593596:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+11:15035:x1876180556963712:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 186us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265702.593618:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 136 00000100:00100000:0.0:1789265702.603201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265702.603294:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556963840 00000100:00100000:3.0:1789265702.603305:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556963840 00000100:00100000:3.0:1789265702.603379:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 137 00000100:00100000:3.0:1789265702.603404:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+11:15035:x1876180556963840:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789265702.603561:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+11:15035:x1876180556963840:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 158us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265702.603578:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 137 00000100:00100000:0.0:1789265702.615627:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265702.616947:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556963968 00000100:00100000:2.0:1789265702.616961:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556963968 00000100:00100000:2.0:1789265702.617028:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 138 00000100:00100000:2.0:1789265702.617038:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+11:15038:x1876180556963968:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265702.617206:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+11:15038:x1876180556963968:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 168us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265702.617214:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 138 00000100:00100000:0.0:1789265702.664369:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265702.664528:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556964096 00000100:00100000:1.0:1789265702.664555:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556964096 00000100:00100000:1.0:1789265702.664624:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 139 00000100:00100000:1.0:1789265702.664636:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+11:15038:x1876180556964096:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265702.665081:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+11:15038:x1876180556964096:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 447us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265702.665090:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 139 00000100:00100000:0.0:1789265702.677417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265702.680963:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556964224 00000100:00100000:3.0:1789265702.680980:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556964224 00000100:00100000:3.0:1789265702.681121:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 140 00000100:00100000:3.0:1789265702.681132:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+11:15038:x1876180556964224:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265702.681299:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+11:15038:x1876180556964224:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 167us (3891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265702.681307:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 140 00000100:00100000:0.0:1789265702.690823:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265702.691113:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556964352 00000100:00100000:1.0:1789265702.691122:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556964352 00000100:00100000:1.0:1789265702.691175:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 141 00000100:00100000:1.0:1789265702.691186:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f3b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+11:15035:x1876180556964352:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789265702.691202:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265702.691233:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bce00/0xbbfdc9019c1d5057 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9195c0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265702.691263:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bce00/0xbbfdc9019c1d5057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195c0 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265702.691275:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bce00/0xbbfdc9019c1d5057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195c0 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265702.691285:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bce00, rc 0) 00000100:00100000:1.0:1789265702.691347:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f3b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+12:15035:x1876180556964352:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 162us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265702.691353:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 141 00000100:00100000:0.0:1789265702.700921:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265702.701090:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556964480 00000100:00100000:3.0:1789265702.701102:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556964480 00000100:00100000:3.0:1789265702.701149:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 142 00000100:00100000:3.0:1789265702.701158:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+12:15035:x1876180556964480:12345-192.168.202.42@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789265702.701185:0:17138:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789265702.701211:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789265702.701216:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789265702.701218:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789265702.701221:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789265702.701223:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789265702.708735:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+12:15035:x1876180556964480:12345-192.168.202.42@tcp:256:mount.lustre.0 Request processed in 7567us (7814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265702.708753:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 142 00000100:00100000:0.0:1789265702.716391:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265702.716567:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556964608 00000100:00100000:2.0:1789265702.716578:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556964608 00000100:00100000:2.0:1789265702.716639:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 143 00000100:00100000:2.0:1789265702.716649:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+12:15035:x1876180556964608:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789265702.716665:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265702.716685:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937782163600/0xbbfdc9019c1d505e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9195c7 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265702.716715:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937782163600/0xbbfdc9019c1d505e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195c7 expref: 13 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265702.716727:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937782163600/0xbbfdc9019c1d505e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195c7 expref: 13 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265702.716736:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937782163600, rc 0) 00000100:00100000:2.0:1789265702.716809:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:15035:x1876180556964608:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 161us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265702.716815:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 143 00000100:00100000:0.0:1789265702.722225:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265702.722307:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556964736 00000100:00100000:3.0:1789265702.722317:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556964736 00000100:00100000:3.0:1789265702.722395:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 144 00000100:00100000:3.0:1789265702.722405:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:15035:x1876180556964736:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789265702.722578:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:15035:x1876180556964736:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 174us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265702.722586:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 144 00000100:00100000:0.0:1789265702.726111:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265702.726823:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556964864 00000100:00100000:1.0:1789265702.726931:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556964864 00000100:00100000:1.0:1789265702.727042:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 145 00000100:00100000:1.0:1789265702.727053:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:15035:x1876180556964864:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789265702.727202:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:15035:x1876180556964864:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 150us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265702.727210:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 145 00000100:00100000:0.0:1789265702.732182:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265702.732298:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556964992 00000100:00100000:2.0:1789265702.732309:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556964992 00000100:00100000:2.0:1789265702.732372:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 146 00000100:00100000:2.0:1789265702.732382:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:15047:x1876180556964992:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265702.732546:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:15047:x1876180556964992:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 156us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265702.732554:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 146 00000100:00100000:0.0:1789265702.745076:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265702.750302:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556965120 00000100:00100000:1.0:1789265702.750319:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556965120 00000100:00100000:1.0:1789265702.750400:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 147 00000100:00100000:1.0:1789265702.750412:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:15047:x1876180556965120:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265702.750879:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:15047:x1876180556965120:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 449us (5792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265702.750887:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 147 00000100:00100000:0.0:1789265702.766031:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265702.766073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265702.766103:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265702.766137:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265702.766161:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265702.766198:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265702.766228:0:19187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556966144 00000100:00100000:0.0:1789265702.766240:0:19187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556966144 00000100:00100000:0.0:1789265702.766289:0:19187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556966272 00000100:00100000:0.0:1789265702.766292:0:19187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556966272 00000100:00100000:0.0:1789265702.766313:0:19187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:0.0:1789265702.766323:0:19187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:296b6286-1162-4204-a595-38172c479be3+6:2398:x1876180556966144:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265702.766478:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556965248 00000100:00100000:3.0:1789265702.766483:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556965248 00000100:00100000:3.0:1789265702.766499:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556965504 00000100:00100000:3.0:1789265702.766501:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556965504 00000100:00100000:3.0:1789265702.766508:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556965888 00000100:00100000:3.0:1789265702.766511:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556965888 00000100:00100000:3.0:1789265702.766526:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556966016 00000100:00100000:3.0:1789265702.766528:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556966016 00000100:00100000:3.0:1789265702.766560:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:3.0:1789265702.766566:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+7:2398:x1876180556965888:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265702.766648:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:1.0:1789265702.766657:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+6:2398:x1876180556966016:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265702.766736:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:2.0:1789265702.766745:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:296b6286-1162-4204-a595-38172c479be3+5:2398:x1876180556966272:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265702.766824:0:19187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:296b6286-1162-4204-a595-38172c479be3+6:2398:x1876180556966144:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 501us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265702.766831:0:19187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:3.0:1789265702.769679:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+7:2398:x1876180556965888:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 3101us (3563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265702.769696:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:3.0:1789265702.769737:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:3.0:1789265702.769744:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1876180556965248:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789265702.769979:0:17144:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3745b3d0-dd9e-43a3-937e-965b55464c77@192.168.202.42@tcp t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:3.0:1789265702.770017:0:17144:0:(genops.c:1385:class_connect()) connect: client 3745b3d0-dd9e-43a3-937e-965b55464c77, cookie 0xbbfdc9019c1d5065 00000004:00100000:3.0:1789265702.770045:0:17144:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1789265702.770139:0:17144:0:(import.c:65:import_set_state_nolock()) ffff937643e28800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265702.770187:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+6:2396:x1876180556965248:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 440us (4167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265702.770210:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:3.0:1789265702.770227:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:3.0:1789265702.770232:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1876180556965504:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789265702.770249:0:17144:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 3745b3d0-dd9e-43a3-937e-965b55464c77@192.168.202.42@tcp t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:3.0:1789265702.770272:0:17144:0:(genops.c:1385:class_connect()) connect: client 3745b3d0-dd9e-43a3-937e-965b55464c77, cookie 0xbbfdc9019c1d506c 00000004:00100000:3.0:1789265702.770285:0:17144:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1789265702.770329:0:17144:0:(import.c:65:import_set_state_nolock()) ffff937643e2c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265702.770366:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+6:2396:x1876180556965504:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 120us (4280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265702.770373:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:1.0:1789265702.770603:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+6:2398:x1876180556966016:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 3945us (4439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265702.770611:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:2.0:1789265702.770936:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:296b6286-1162-4204-a595-38172c479be3+5:2398:x1876180556966272:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 4191us (4734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265702.770947:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:0.0:1789265702.775853:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265702.776026:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556965376 00000100:00100000:3.0:1789265702.776037:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556965376 00000100:00100000:3.0:1789265702.776115:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:3.0:1789265702.776125:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+6:0:x1876180556965376:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789265702.776165:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789265702.776246:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+6:0:x1876180556965376:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 122us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265702.776254:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00080000:0.0:1789265702.778389:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265702.778856:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265702.779002:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556965760 00000100:00100000:3.0:1789265702.779013:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556965760 00000100:00100000:3.0:1789265702.779073:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:3.0:1789265702.779084:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+6:15035:x1876180556965760:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789265702.779117:0:19934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789265702.779182:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+6:15035:x1876180556965760:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 100us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265702.779203:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:2.0:1789265702.787600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265702.787746:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556965632 00000100:00100000:3.0:1789265702.787757:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556965632 00000100:00100000:3.0:1789265702.787843:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:3.0:1789265702.787854:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+6:0:x1876180556965632:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789265702.787925:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265702.787995:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+6:0:x1876180556965632:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 143us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265702.788003:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00080000:0.0:1789265702.788514:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265702.792961:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265702.793295:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556966400 00000100:00100000:3.0:1789265702.793305:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556966400 00000100:00100000:3.0:1789265702.793402:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:3.0:1789265702.793411:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+6:15035:x1876180556966400:12345-192.168.202.42@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789265702.793488:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+6:15035:x1876180556966400:12345-192.168.202.42@tcp:40:mount.lustre.0 Request processed in 78us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265702.793493:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:2.0:1789265702.798244:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265702.798520:0:19187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556966528 00000100:00100000:0.0:1789265702.798534:0:19187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556966528 00000100:00100000:0.0:1789265702.798595:0:19187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:0.0:1789265702.798603:0:19187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1876180556966528:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789265702.798648:0:19187:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3745b3d0-dd9e-43a3-937e-965b55464c77@192.168.202.42@tcp t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:0.0:1789265702.798681:0:19187:0:(genops.c:1385:class_connect()) connect: client 3745b3d0-dd9e-43a3-937e-965b55464c77, cookie 0xbbfdc9019c1d5073 00002000:00100000:0.0:1789265702.798694:0:19187:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3745b3d0-dd9e-43a3-937e-965b55464c77/ffff93775184d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789265702.798714:0:19187:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789265702.798809:0:19187:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789265702.798843:0:19187:0:(import.c:65:import_set_state_nolock()) ffff937751848000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265702.798945:0:19187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+6:2396:x1876180556966528:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 341us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265702.798965:0:19187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:2.0:1789265702.801107:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265702.801200:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556966656 00000100:00100000:0.0:1789265702.801211:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556966656 00000100:00100000:0.0:1789265702.801253:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:0.0:1789265702.801262:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1876180556966656:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789265702.801300:0:18651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3745b3d0-dd9e-43a3-937e-965b55464c77@192.168.202.42@tcp t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:0.0:1789265702.801336:0:18651:0:(genops.c:1385:class_connect()) connect: client 3745b3d0-dd9e-43a3-937e-965b55464c77, cookie 0xbbfdc9019c1d507a 00002000:00100000:0.0:1789265702.801350:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3745b3d0-dd9e-43a3-937e-965b55464c77/ffff93775184a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789265702.801558:0:18651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789265702.801657:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789265702.801691:0:18651:0:(import.c:65:import_set_state_nolock()) ffff93775184e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265702.802595:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+6:2396:x1876180556966656:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 1327us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265702.802605:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:1.0:1789265702.806133:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265702.806205:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556966784 00000100:00100000:0.0:1789265702.806214:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556966784 00000100:00100000:0.0:1789265702.806273:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:0.0:1789265702.806283:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3745b3d0-dd9e-43a3-937e-965b55464c77+6:15035:x1876180556966784:12345-192.168.202.42@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789265702.806350:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3745b3d0-dd9e-43a3-937e-965b55464c77+6:15035:x1876180556966784:12345-192.168.202.42@tcp:900:mount.lustre.0 Request processed in 69us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265702.806367:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:2.0:1789265702.808234:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265702.808439:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556966912 00000100:00100000:0.0:1789265702.808448:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556966912 00000100:00100000:0.0:1789265702.808530:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:0.0:1789265702.808553:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+6:15035:x1876180556966912:12345-192.168.202.42@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789265702.808678:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789265702.808765:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+6:15035:x1876180556966912:12345-192.168.202.42@tcp:33:mount.lustre.0 Request processed in 215us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265702.808773:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:2.0:1789265703.020506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265703.020608:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556967040 00000100:00100000:3.0:1789265703.020618:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556967040 00000100:00100000:3.0:1789265703.020688:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:3.0:1789265703.020700:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+6:15070:x1876180556967040:12345-192.168.202.42@tcp:101:mkdir.0 00010000:00010000:3.0:1789265703.020720:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265703.020743:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b000/0xbbfdc9019c1d5081 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9195f8 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265703.020806:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d5088 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265703.020844:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d5088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265703.020885:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d5088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265703.020938:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265703.020943:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265703.020965:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d5088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265703.020992:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b000/0xbbfdc9019c1d5081 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195f8 expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265703.021011:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d5088 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195f8 expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265703.021020:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93775de3d300) 00010000:00010000:3.0:1789265703.021023:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265703.021026:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93775181ac00, rc 0) 00000100:00100000:3.0:1789265703.021085:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+7:15070:x1876180556967040:12345-192.168.202.42@tcp:101:mkdir.0 Request processed in 388us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265703.021092:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00010000:00010000:3.0:1789265703.603092:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265704.436950:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265704.436975:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579076480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265704.437053:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265704.443431:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579076480 00000100:00100000:2.0:1789265704.443445:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579076480 00000100:00100000:2.0:1789265704.443638:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265704.443649:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579076480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265704.443680:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789265704.443764:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579076480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (6710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265704.443771:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265704.443845:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579076480:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265704.443932:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789265704.628101:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265705.459370:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579076608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265705.459453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265705.459557:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579076608 00000100:00100000:3.0:1789265705.459565:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579076608 00000100:00100000:3.0:1789265705.459627:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789265705.459637:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579076608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265705.459672:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265705.459723:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579076608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265705.459732:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789265705.459793:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579076608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265705.461222:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265705.461239:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579076864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265705.461295:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265705.461338:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265705.461348:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579076736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265705.461379:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265705.461453:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579076864 00000100:00100000:3.0:1789265705.461460:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579076864 00000100:00100000:3.0:1789265705.461525:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265705.461535:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579076864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265705.461554:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789265705.461596:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180579076864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265705.461602:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265705.461624:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579076736 00000100:00100000:3.0:1789265705.461627:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579076736 00000100:00100000:3.0:1789265705.461647:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789265705.461654:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579076736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265705.461678:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789265705.461714:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579076736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265705.461721:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1789265705.461978:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265705.462020:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876180579076864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265705.462067:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579076736:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789265705.651162:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265705.907556:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789265705.971258:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579077248:0@lo:400:kworker.0 00000100:00100000:2.0:1789265705.971332:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265705.971367:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180579077760:0@lo:400:kworker.0 00000100:00100000:2.0:1789265705.971393:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265705.971417:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789265705.971422:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579077120:0@lo:400:kworker.0 00000100:00100000:2.0:1789265705.971445:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265705.971461:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180579077632:0@lo:400:kworker.0 00000100:00100000:2.0:1789265705.971479:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265705.971493:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180579078144:0@lo:400:kworker.0 00000100:00100000:2.0:1789265705.971543:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265705.971575:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579077248 00000100:00100000:2.0:1789265705.971583:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579077248 00000100:00100000:2.0:1789265705.971647:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579077120 00000100:00100000:2.0:1789265705.971650:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579077120 00000100:00100000:2.0:1789265705.971670:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265705.971678:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376435a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579077248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265705.971729:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376435a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579077248:12345-0@lo:400:kworker.0 Request processed in 52us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265705.971750:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265705.971768:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265705.971774:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579077120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265705.971801:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579077120:12345-0@lo:400:kworker.0 Request processed in 28us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265705.971807:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265705.971843:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579077120:0@lo:400:kworker.0 00000100:00100000:2.0:1789265705.971898:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789265705.971912:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579077248:0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.971991:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579077760 00000100:00100000:1.0:1789265705.971996:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579077760 00000100:00100000:1.0:1789265705.972032:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579077632 00000100:00100000:1.0:1789265705.972034:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579077632 00000100:00100000:1.0:1789265705.972046:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579078144 00000100:00100000:1.0:1789265705.972048:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579078144 00000100:00100000:1.0:1789265705.972062:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789265705.972068:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180579077760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.972107:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876180579077760:12345-0@lo:400:kworker.0 Request processed in 39us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265705.972113:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789265705.972130:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265705.972137:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180579077632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.972163:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876180579077632:12345-0@lo:400:kworker.0 Request processed in 27us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265705.972169:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265705.972190:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789265705.972196:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180579078144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.972225:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180579078144:12345-0@lo:400:kworker.0 Request processed in 30us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265705.972230:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789265705.972251:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579077376:0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.972273:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265705.972289:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180579077888:0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.972309:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265705.972320:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789265705.972326:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579076992:0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.972350:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265705.972372:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579077504:0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.972392:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265705.972409:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9376435aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180579078016:0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.972434:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265705.972451:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579077504 00000100:00100000:1.0:1789265705.972454:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579077504 00000100:00100000:1.0:1789265705.972476:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265705.972481:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579077504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.972521:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579077504:12345-0@lo:400:kworker.0 Request processed in 27us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265705.972527:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265705.972549:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579077504:0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.972563:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579077376 00000100:00100000:1.0:1789265705.972572:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579077376 00000100:00100000:1.0:1789265705.972587:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579077888 00000100:00100000:1.0:1789265705.972589:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579077888 00000100:00100000:1.0:1789265705.972599:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579078016 00000100:00100000:1.0:1789265705.972601:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579078016 00000100:00100000:1.0:1789265705.972612:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265705.972616:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579077376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.972645:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180579077376:12345-0@lo:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265705.972650:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265705.972660:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265705.972666:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180579077888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.972686:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180579077888:12345-0@lo:400:kworker.0 Request processed in 21us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265705.972691:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265705.972700:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265705.972705:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180579078016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.972725:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180579078016:12345-0@lo:400:kworker.0 Request processed in 20us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265705.972730:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265705.972750:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180579078016:0@lo:400:kworker.0 00000100:00100000:1.0:1789265705.972759:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180579077376:0@lo:400:kworker.0 00010000:00080000:1.0:1789265705.972770:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435ab800 x1876180579077888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265705.972780:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180579077888:0@lo:400:kworker.0 00000100:00080000:0.0:1789265705.972883:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265705.972888:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265705.972890:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265705.973097:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579076992 00000100:00100000:3.0:1789265705.973102:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579076992 00000100:00100000:3.0:1789265705.973130:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789265705.973144:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:3643:x1876180579076992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265705.973187:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:3643:x1876180579076992:12345-0@lo:400:kworker.0 Request processed in 45us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265705.973193:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789265705.973229:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579076992:0@lo:400:kworker.0 00000100:00100000:0.0:1789265705.973532:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579078400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265705.973565:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265705.973641:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579078400 00000100:00100000:1.0:1789265705.973645:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579078400 00000100:00100000:1.0:1789265705.973674:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789265705.973680:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579078400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789265705.973702:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789265705.973802:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579078272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265705.973831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265705.973879:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876180579077632:0@lo:400:kworker.0 00010000:00080000:2.0:1789265705.973895:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9376435a8000 x1876180579078144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265705.973905:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180579078144:0@lo:400:kworker.0 00000100:00100000:2.0:1789265705.973921:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9376435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876180579077760:0@lo:400:kworker.0 00000100:00100000:2.0:1789265705.973956:0:18653:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789265705.973964:0:18653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1789265705.974060:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579078272 00000100:00100000:2.0:1789265705.974064:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579078272 00000100:00100000:2.0:1789265705.974162:0:19984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265705.974171:0:19984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579078272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265705.974181:0:19984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789265705.974213:0:19984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579078272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265705.974220:0:19984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789265705.974248:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579078272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265705.991693:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579078400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17998us (18112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265705.991712:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265705.992663:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579078400:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789265706.488512:0:17877:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3745b3d0-dd9e-43a3-937e-965b55464c77 00000001:00100000:2.0:1789265706.488527:0:17877:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 296b6286-1162-4204-a595-38172c479be3 00000001:00100000:2.0:1789265706.489517:0:17124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3745b3d0-dd9e-43a3-937e-965b55464c77 00000001:00100000:2.0:1789265706.489543:0:17124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 296b6286-1162-4204-a595-38172c479be3 00000001:00100000:1.0:1789265706.499119:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3745b3d0-dd9e-43a3-937e-965b55464c77 00000001:00100000:1.0:1789265706.499132:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 296b6286-1162-4204-a595-38172c479be3 00010000:00010000:1.0:1789265706.677516:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265707.247318:0:20021:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789265707.702775:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265708.289072:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265708.289120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265708.289159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265708.289185:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265708.289204:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265708.289217:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265708.289232:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265708.289245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265708.289262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265708.289286:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556967424 00000100:00100000:2.0:1789265708.289295:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556967424 00000100:00100000:2.0:1789265708.289349:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556967936 00000100:00100000:2.0:1789265708.289352:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556967936 00000100:00100000:2.0:1789265708.289362:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556967296 00000100:00100000:2.0:1789265708.289364:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556967296 00000100:00100000:2.0:1789265708.289375:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556967808 00000100:00100000:2.0:1789265708.289377:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556967808 00000100:00100000:2.0:1789265708.289392:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:2.0:1789265708.289402:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+5:2398:x1876180556967424:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265708.289470:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+5:2398:x1876180556967424:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 70us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265708.289478:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:2.0:1789265708.289505:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:2.0:1789265708.289511:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2398:x1876180556967936:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265708.289532:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2398:x1876180556967936:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265708.289553:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:2.0:1789265708.289572:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:2.0:1789265708.289579:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+6:2398:x1876180556967296:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265708.289601:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+6:2398:x1876180556967296:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265708.289606:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:2.0:1789265708.289615:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:2.0:1789265708.289620:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+6:2398:x1876180556967808:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265708.289635:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+6:2398:x1876180556967808:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 15us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265708.289641:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:2.0:1789265708.289662:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556967680 00000100:00100000:2.0:1789265708.289665:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556967680 00000100:00100000:2.0:1789265708.289685:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556968192 00000100:00100000:2.0:1789265708.289688:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556968192 00000100:00100000:2.0:1789265708.289699:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556967552 00000100:00100000:2.0:1789265708.289701:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556967552 00000100:00100000:2.0:1789265708.289724:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556968064 00000100:00100000:2.0:1789265708.289727:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556968064 00000100:00100000:2.0:1789265708.289740:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:2.0:1789265708.289746:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:296b6286-1162-4204-a595-38172c479be3+5:2398:x1876180556967680:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265708.289770:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:296b6286-1162-4204-a595-38172c479be3+5:2398:x1876180556967680:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265708.290079:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:1.0:1789265708.290906:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556967168 00000100:00100000:1.0:1789265708.290914:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556967168 00000100:00100000:1.0:1789265708.290970:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 149 00000100:00100000:1.0:1789265708.290979:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:2398:x1876180556967168:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265708.291030:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:2398:x1876180556967168:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 52us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265708.291037:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 149 00000100:00100000:0.0:1789265708.299235:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:0.0:1789265708.299266:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+6:2398:x1876180556968192:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265708.299358:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+6:2398:x1876180556968192:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 110us (10152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265708.299385:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:0.0:1789265708.299419:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:0.0:1789265708.299427:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:296b6286-1162-4204-a595-38172c479be3+5:2398:x1876180556967552:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265708.299459:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:296b6286-1162-4204-a595-38172c479be3+5:2398:x1876180556967552:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 34us (10226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265708.299467:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:0.0:1789265708.299479:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:0.0:1789265708.299497:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2398:x1876180556968064:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1789265708.299521:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2398:x1876180556968064:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 35us (10258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265708.299527:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00080000:0.0:1789265708.299552:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265708.299557:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265708.299561:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265708.299564:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:1.0:1789265708.571271:0:19464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3745b3d0-dd9e-43a3-937e-965b55464c77 00010000:00010000:1.0:1789265708.723094:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265709.555140:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265709.555175:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579078528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265709.555242:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265709.555396:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579078528 00000100:00100000:0.0:1789265709.555404:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579078528 00000100:00100000:0.0:1789265709.555491:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265709.555505:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579078528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265709.555534:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789265709.555579:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579078528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265709.555586:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265709.555809:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579078528:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789265709.557572:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789265709.747164:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265710.580716:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579078656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265710.580801:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265710.580870:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265710.580876:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579078784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265710.580894:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265710.580925:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579078656 00000100:00100000:0.0:1789265710.580931:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579078656 00000100:00100000:0.0:1789265710.580966:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789265710.580972:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579078656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265710.580999:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789265710.581030:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579078656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265710.581034:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789265710.581050:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579078784 00000100:00100000:0.0:1789265710.581052:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579078784 00000100:00100000:0.0:1789265710.581073:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265710.581077:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579078784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265710.581088:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789265710.581105:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579078784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 28us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265710.581108:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789265710.581120:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265710.581144:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579078784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265710.581151:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579078656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265710.583938:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265710.583959:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579078912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265710.584021:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265710.584084:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579078912 00000100:00100000:0.0:1789265710.584091:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579078912 00000100:00100000:0.0:1789265710.584135:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265710.584144:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579078912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265710.584175:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789265710.584218:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180579078912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265710.584225:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789265710.584273:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876180579078912:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789265710.771108:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265711.091082:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265711.091101:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579079040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265711.091156:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265711.091392:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265711.091401:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579079168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265711.091411:0:19984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579079040 00000100:00100000:3.0:1789265711.091420:0:19984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579079040 00000100:00100000:0.0:1789265711.091425:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265711.091447:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579079168 00000100:00100000:0.0:1789265711.091449:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579079168 00000100:00100000:0.0:1789265711.091536:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265711.091543:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579079168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265711.091567:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265711.091606:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579079168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265711.091610:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265711.091623:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265711.091627:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579079040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265711.091633:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1789265711.091644:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265711.091656:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579079040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265711.091660:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789265711.091738:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579079040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265711.092380:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579079168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265711.094064:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3646:1876180579079296:0@lo:400:kworker.0 00000100:00100000:2.0:1789265711.094114:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265711.094190:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579079424:0@lo:400:kworker.0 00000100:00100000:1.0:1789265711.094228:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265711.094267:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579079424 00000100:00100000:1.0:1789265711.094280:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579079424 00000100:00100000:1.0:1789265711.094320:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265711.094327:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579079424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265711.094361:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579079424:12345-0@lo:400:kworker.0 Request processed in 35us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265711.094366:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265711.094371:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579079296 00000100:00100000:3.0:1789265711.094377:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579079296 00000100:00080000:1.0:1789265711.094383:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265711.094401:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579079424:0@lo:400:kworker.0 00000100:00100000:3.0:1789265711.094419:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789265711.094428:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:3646:x1876180579079296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265711.094443:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180579079552:0@lo:400:kworker.0 00000100:00100000:1.0:1789265711.094483:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265711.094746:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579079680:0@lo:400:kworker.0 00000100:00100000:0.0:1789265711.094776:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265711.098525:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:3646:x1876180579079296:12345-0@lo:400:kworker.0 Request processed in 4014us (4325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265711.098543:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789265711.100484:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265711.100551:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265711.100569:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180579079936:0@lo:400:kworker.0 00000100:00100000:1.0:1789265711.100636:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265711.100693:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180579080064:0@lo:400:kworker.0 00000100:00100000:1.0:1789265711.100714:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265711.100746:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579079552 00000100:00100000:1.0:1789265711.100754:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579079552 00000100:00100000:1.0:1789265711.100795:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579079680 00000100:00100000:1.0:1789265711.100798:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579079680 00000100:00100000:1.0:1789265711.100812:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579079936 00000100:00100000:1.0:1789265711.100814:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579079936 00000100:00100000:1.0:1789265711.100837:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579080064 00000100:00100000:1.0:1789265711.100840:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579080064 00000100:00100000:1.0:1789265711.100875:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789265711.100887:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180579079552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265711.100952:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180579079552:12345-0@lo:400:kworker.0 Request processed in 68us (6469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265711.104093:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789265711.104138:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789265711.104153:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579079680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265711.106010:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3646:1876180579079296:0@lo:400:kworker.0 00000100:00100000:2.0:1789265711.106065:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789265711.106077:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180579079936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265711.106144:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180579079936:12345-0@lo:400:kworker.0 Request processed in 71us (5508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265711.106151:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789265711.106170:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789265711.106178:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180579080064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265711.106206:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180579080064:12345-0@lo:400:kworker.0 Request processed in 29us (5490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265711.106211:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789265711.106362:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180579079808:0@lo:400:kworker.0 00000100:00100000:0.0:1789265711.106406:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265711.106481:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579079808 00000100:00100000:2.0:1789265711.106489:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579079808 00000100:00100000:2.0:1789265711.106531:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789265711.106539:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180579079808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265711.106570:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876180579079808:12345-0@lo:400:kworker.0 Request processed in 33us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265711.106577:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789265711.106909:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876180579079680:12345-0@lo:400:kworker.0 Request processed in 2761us (12128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265711.106917:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789265711.106940:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265711.106944:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265711.106983:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180579080064:0@lo:400:kworker.0 00010000:00080000:1.0:1789265711.107001:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f3e1c00 x1876180579079936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265711.107012:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180579079936:0@lo:400:kworker.0 00000100:00100000:1.0:1789265711.107026:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180579079552:0@lo:400:kworker.0 00000100:00100000:2.0:1789265711.107182:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265711.107193:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180579080192:0@lo:400:kworker.0 00000100:00100000:2.0:1789265711.107241:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265711.107467:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579080192 00000100:00100000:3.0:1789265711.107472:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579080192 00000100:00100000:3.0:1789265711.107520:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265711.107527:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180579080192:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789265711.107685:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93777f3e1500 x1876180579080192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265711.107697:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876180579080192:0@lo:400:kworker.0 00000100:00080000:2.0:1789265711.107711:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265711.108020:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876180579080192:12345-0@lo:400:kworker.0 Request processed in 491us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265711.108028:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789265711.108161:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876180579079680:0@lo:400:kworker.0 00000100:00100000:0.0:1789265711.108183:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876180579079808:0@lo:400:kworker.0 00000040:00080000:3.0:1789265711.411558:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1789265711.653172:0:20169:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7e94e200 20000000:00000080:1.0:1789265711.653189:0:20169:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff937751801000 uarg=0000000000000000 20000000:01000000:1.0:1789265711.653239:0:20169:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789265711.653244:0:20169:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789265711.653249:0:20169:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789265711.654145:0:20170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789265711.654397:0:20169:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789265711.661709:0:20169:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789265711.661754:0:20169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.661775:0:20169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d4d24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d1d expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.661783:0:20169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d4d32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d2b expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.661790:0:20169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9376435fc200/0xbbfdc9019c1d4d71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4d6a expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.661798:0:20169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937642393c00/0xbbfdc9019c1d4ed6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d4ecf expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.661807:0:20169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9377532bc400/0xbbfdc9019c1d501f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919557 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.661815:0:20169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937782163600/0xbbfdc9019c1d505e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195c7 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.661822:0:20169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.661911:0:20169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937782163600/0xbbfdc9019c1d505e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195c7 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.661930:0:20169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff937782163600/0xbbfdc9019c1d505e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195c7 expref: 12 pid: 17137 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265711.661970:0:20169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f464700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1876180579080320:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265711.662076:0:20169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bc400/0xbbfdc9019c1d501f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919557 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.662086:0:20169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9377532bc400/0xbbfdc9019c1d501f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919557 expref: 12 pid: 17136 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265711.662095:0:20169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f466a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1876180579080448:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265711.662121:0:20169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937642393c00/0xbbfdc9019c1d4ed6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d4ecf expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.662129:0:20169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff937642393c00/0xbbfdc9019c1d4ed6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4ecf expref: 23 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265711.662137:0:20169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f467b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1876180579080576:0@lo:104: 00000100:00100000:3.0:1789265711.662173:0:20169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265711.662204:0:20169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9376435fc200/0xbbfdc9019c1d4d71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d4d6a expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.662211:0:20169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9376435fc200/0xbbfdc9019c1d4d71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d6a expref: 23 pid: 17137 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265711.662219:0:20169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f464000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1876180579080704:0@lo:104: 00000100:00100000:3.0:1789265711.662237:0:20169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265711.662258:0:20169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d4d32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d4d2b expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.662266:0:20169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d4d32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d2b expref: 23 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265711.662354:0:20169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f465c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1876180579080832:0@lo:104: 00000100:00100000:3.0:1789265711.662375:0:20169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265711.662390:0:20169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d4d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbbfdc9019c1d4d1d expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.662400:0:20169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d4d24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d1d expref: 23 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265711.662407:0:20169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f467480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1876180579080960:0@lo:104: 00000100:00100000:3.0:1789265711.662425:0:20169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265711.662435:0:20169:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377508c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265711.662965:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579080576 00000100:00100000:0.0:1789265711.662974:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579080576 00000100:00100000:0.0:1789265711.663010:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579080704 00000100:00100000:0.0:1789265711.663013:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579080704 00000100:00100000:0.0:1789265711.663024:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579080832 00000100:00100000:0.0:1789265711.663026:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579080832 00000100:00100000:0.0:1789265711.663034:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579080960 00000100:00100000:0.0:1789265711.663036:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579080960 00000100:00100000:0.0:1789265711.663048:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265711.663057:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f464380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+6:20169:x1876180579080576:12345-0@lo:104: 00010000:00010000:0.0:1789265711.663070:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4ed6 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663127:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265711.663132:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f464380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+6:20169:x1876180579080576:12345-0@lo:104: Request processed in 77us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265711.663139:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265711.663157:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265711.663163:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+5:20169:x1876180579080704:12345-0@lo:104: 00010000:00010000:0.0:1789265711.663170:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4d71 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663208:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789265711.663213:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+5:20169:x1876180579080704:12345-0@lo:104: Request processed in 51us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265711.663219:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265711.663231:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265711.663237:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f466300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+4:20169:x1876180579080832:12345-0@lo:104: 00010000:00010000:0.0:1789265711.663244:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4d32 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663271:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789265711.663288:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f466300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+4:20169:x1876180579080832:12345-0@lo:104: Request processed in 53us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265711.663294:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265711.663306:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265711.663312:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f467800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+3:20169:x1876180579080960:12345-0@lo:104: 00010000:00010000:0.0:1789265711.663320:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4d24 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663364:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789265711.663369:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f467800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+3:20169:x1876180579080960:12345-0@lo:104: Request processed in 59us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265711.663375:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789265711.663393:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789265711.663400:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4ed6 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663417:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93774167e800 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:0.0:1789265711.663421:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d4ed6 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663429:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d4ed6 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265711.663436:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d4ed6 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265711.663442:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265711.663679:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4ed6 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663687:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265711.663715:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4ed6 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663723:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff93774167e800/0xbbfdc9019c1d4ecf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4ed6 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663737:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789265711.663740:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4d71 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663746:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393600 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:0.0:1789265711.663749:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d4d71 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663767:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d4d71 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265711.663773:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d4d71 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265711.663777:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265711.663790:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4d71 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663795:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265711.663808:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4d71 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663814:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff937642393600/0xbbfdc9019c1d4d6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4d71 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663822:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265711.663824:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4d32 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663830:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377465a5200 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:0.0:1789265711.663833:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d4d32 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663840:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d4d32 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265711.663847:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d4d32 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265711.663881:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265711.663894:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4d32 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663900:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265711.663906:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4d32 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663913:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9377465a5200/0xbbfdc9019c1d4d2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4d32 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663922:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265711.663925:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbbfdc9019c1d4d24 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663930:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9376435fda00 already unused, calling callback (ffffffffc13cbc20) 10000000:00010000:0.0:1789265711.663934:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbbfdc9019c1d4d24 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663941:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbbfdc9019c1d4d24 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265711.663946:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbbfdc9019c1d4d24 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265711.663951:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265711.663960:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4d24 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663965:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265711.663977:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4d24 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.663983:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9376435fda00/0xbbfdc9019c1d4d1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbbfdc9019c1d4d24 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265711.664000:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265711.664002:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265711.664003:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265711.664027:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579081472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265711.664063:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265711.664097:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265711.664103:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579081088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265711.664124:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265711.664147:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579081216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265711.664168:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265711.664183:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265711.664188:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579081344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265711.664208:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265711.664426:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265711.664441:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579081472 00000100:00100000:1.0:1789265711.664446:0:17898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579081472 00010000:00010000:1.0:1789265711.664487:0:17898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d4d24 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d1d expref: 24 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265711.664516:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579081088 00000100:00100000:1.0:1789265711.664519:0:17898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579081088 00010000:00010000:1.0:1789265711.664531:0:17898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937642393c00/0xbbfdc9019c1d4ed6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4ecf expref: 25 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265711.664542:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579081216 00000100:00100000:1.0:1789265711.664544:0:17898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579081216 00010000:00010000:1.0:1789265711.664554:0:17898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9376435fc200/0xbbfdc9019c1d4d71 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d6a expref: 26 pid: 17137 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265711.664576:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579081344 00000100:00100000:1.0:1789265711.664579:0:17898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579081344 00010000:00010000:1.0:1789265711.664589:0:17898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d4d32 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d2b expref: 27 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265711.664602:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265711.664609:0:17898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+27:3645:x1876180579081472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265711.664619:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265711.664625:0:17898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d4d24 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d1d expref: 27 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.664634:0:17898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d4d24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d1d expref: 27 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.664650:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265711.664690:0:17898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+27:3645:x1876180579081472:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265711.664697:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265711.664716:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265711.664731:0:17898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+26:3645:x1876180579081088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265711.664738:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265711.664742:0:17898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937642393c00/0xbbfdc9019c1d4ed6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4ecf expref: 26 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.664750:0:17898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937642393c00/0xbbfdc9019c1d4ed6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4ecf expref: 26 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.664760:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265711.664782:0:17898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+26:3645:x1876180579081088:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265711.664788:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265711.664800:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265711.664805:0:17898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+25:3643:x1876180579081216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265711.664812:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265711.664816:0:17898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9376435fc200/0xbbfdc9019c1d4d71 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d6a expref: 25 pid: 17137 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.664824:0:17898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9376435fc200/0xbbfdc9019c1d4d71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d6a expref: 25 pid: 17137 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.664833:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265711.664855:0:17898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+25:3643:x1876180579081216:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265711.664882:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265711.664893:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265711.664898:0:17898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:3643:x1876180579081344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265711.664905:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265711.664913:0:17898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d4d32 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d2b expref: 24 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.664922:0:17898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d4d32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d2b expref: 24 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.664931:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265711.664951:0:17898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:3643:x1876180579081344:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265711.664957:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265711.664992:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579081344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265711.665001:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3643:1876180579081216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265711.670082:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265711.670158:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265711.670206:0:20169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f464700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1876180579080320:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265711.670217:0:20169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f466a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1876180579080448:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265711.670230:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937642393c00/0xbbfdc9019c1d4ed6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d4ecf expref: 23 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265711.670246:0:20169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f467b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1876180579080576:0@lo:104: 00010000:00010000:3.0:1789265711.670257:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9376435fc200/0xbbfdc9019c1d4d71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d6a expref: 22 pid: 17137 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265711.670266:0:20169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f464000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1876180579080704:0@lo:104: 00010000:00010000:3.0:1789265711.670277:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9376435fd200/0xbbfdc9019c1d4d32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d2b expref: 21 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265711.670298:0:20169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f465c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1876180579080832:0@lo:104: 00010000:00010000:3.0:1789265711.670328:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bcc00/0xbbfdc9019c1d4d24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbbfdc9019c1d4d1d expref: 20 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265711.670336:0:20169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f467480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1876180579080960:0@lo:104: 00010000:00010000:3.0:1789265711.670363:0:20169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265711.670927:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556968320 00000100:00100000:1.0:1789265711.670936:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556968320 00010000:00010000:1.0:1789265711.670969:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937782163600/0xbbfdc9019c1d505e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195c7 expref: 13 pid: 17137 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265711.670990:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556968448 00000100:00100000:1.0:1789265711.670994:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556968448 00010000:00010000:1.0:1789265711.671005:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9377532bc400/0xbbfdc9019c1d501f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919557 expref: 14 pid: 17136 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265711.671021:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:1.0:1789265711.671029:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643659c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba7beb9c-943e-4381-81e6-43a0a05c3424+14:2400:x1876180556968320:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265711.671055:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265711.671060:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937782163600/0xbbfdc9019c1d505e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195c7 expref: 14 pid: 17137 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671072:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937782163600/0xbbfdc9019c1d505e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195c7 expref: 14 pid: 17137 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671097:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937782163600/0xbbfdc9019c1d505e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195c7 expref: 14 pid: 17137 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671110:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265711.671162:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643659c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:2400:x1876180556968320:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 134us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265711.671170:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:1.0:1789265711.671213:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:1.0:1789265711.671220:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba7beb9c-943e-4381-81e6-43a0a05c3424+12:2400:x1876180556968448:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265711.671226:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265711.671231:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9377532bc400/0xbbfdc9019c1d501f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919557 expref: 12 pid: 17136 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671240:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9377532bc400/0xbbfdc9019c1d501f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919557 expref: 12 pid: 17136 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671250:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9377532bc400/0xbbfdc9019c1d501f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919557 expref: 12 pid: 17136 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671261:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671269:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671281:0:17129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671298:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671306:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671313:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671319:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181b200 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265711.671323:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671331:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671343:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.671352:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265711.671368:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba7beb9c-943e-4381-81e6-43a0a05c3424+11:2400:x1876180556968448:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 149us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265711.671374:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:0.0:1789265711.671849:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579081088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265711.671882:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579081472:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265711.672125:0:20169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.672135:0:20169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265711.672142:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d508f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265711.795188:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265712.820881:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789265713.010962:0:17141:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265713.010970:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9377528e4000 from 13 10000000:01000000:0.0:1789265713.010976:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265713.011021:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392e00/0xbbfdc9019c1d5096 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265713.011033:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642392e00/0xbbfdc9019c1d5096 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265713.011053:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642392e00/0xbbfdc9019c1d5096 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265713.011079:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579081600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265713.011147:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265713.011191:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3906c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265713.011506:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579081600 00000100:00100000:3.0:1789265713.011531:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579081600 00000100:00100000:3.0:1789265713.011587:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789265713.011597:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+20:17141:x1876180579081600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265713.011611:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265713.011626:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93775181b000/0xbbfdc9019c1d509d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d5096 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265713.011649:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93775181b000/0xbbfdc9019c1d509d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d5096 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265713.011661:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93775181b000/0xbbfdc9019c1d509d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d5096 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265713.011683:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93775181b000, rc 0) 00000100:00100000:3.0:1789265713.011726:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:17141:x1876180579081600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265713.011732:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789265713.012042:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579081600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265713.012059:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642392e00/0xbbfdc9019c1d5096 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d509d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265713.012068:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642392e00/0xbbfdc9019c1d5096 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d509d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265713.012138:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579081728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265713.012169:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265713.012201:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3906c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265713.012469:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579081728 00000100:00100000:3.0:1789265713.012474:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579081728 00000100:00100000:3.0:1789265713.013783:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789265713.013800:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:17141:x1876180579081728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265713.013990:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:17141:x1876180579081728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265713.014064:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579081728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265713.014108:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579081856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265713.014152:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265713.014179:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9376422f4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265713.014194:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579081856 00000100:00100000:2.0:1789265713.014198:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579081856 00000100:00100000:3.0:1789265713.017777:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789265713.019655:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789265713.019674:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643513450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:17141:x1876180579081856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265713.019947:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643513450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:17141:x1876180579081856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 279us (5793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265713.019956:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789265713.026143:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579081856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789265713.027758:0:20213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789265713.031921:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789265713.031964:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265713.031977:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392e00/0xbbfdc9019c1d5096 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d509d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265713.032000:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642392e00/0xbbfdc9019c1d5096 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d509d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265713.032012:0:17141:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265713.032015:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93776128f000 from 13 10000000:01000000:1.0:1789265713.032018:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265713.032059:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bd000/0xbbfdc9019c1d50a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265713.032068:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bd000/0xbbfdc9019c1d50a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265713.032080:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bd000/0xbbfdc9019c1d50a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265713.032106:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579081984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265713.032174:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265713.032218:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579081984 00000100:00100000:1.0:1789265713.032226:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579081984 00000100:00100000:1.0:1789265713.032270:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789265713.032279:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+21:17141:x1876180579081984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265713.032292:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265713.032304:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d50ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d50a4 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265713.032328:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d50ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d50a4 expref: 22 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265713.032339:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377532bda00/0xbbfdc9019c1d50ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d50a4 expref: 22 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265713.032355:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bda00, rc 0) 00000100:00100000:1.0:1789265713.032476:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:17141:x1876180579081984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265713.032484:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789265713.032623:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff937781c42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265713.032644:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579081984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265713.032658:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bd000/0xbbfdc9019c1d50a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d50ab expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265713.032667:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bd000/0xbbfdc9019c1d50a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d50ab expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265713.032723:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579082112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265713.032750:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265713.032772:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579082112 00000100:00100000:1.0:1789265713.032776:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579082112 00000100:00100000:1.0:1789265713.032798:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789265713.032804:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:17141:x1876180579082112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265713.032923:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:17141:x1876180579082112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265713.032930:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789265713.032951:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff937781c42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265713.032962:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579082112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265713.032988:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579082240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265713.033033:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265713.033053:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579082240 00000100:00100000:1.0:1789265713.033057:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579082240 00000100:00100000:1.0:1789265713.033078:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789265713.033083:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:17141:x1876180579082240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265713.033148:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:17141:x1876180579082240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265713.033155:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789265713.033183:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff937781c42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265713.033194:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579082240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789265713.037660:0:20214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789265713.038120:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789265713.038144:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265713.038156:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bd000/0xbbfdc9019c1d50a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d50ab expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265713.038169:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bd000/0xbbfdc9019c1d50a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d50ab expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265713.038180:0:17141:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789265713.038182:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93775f5f4800 from 13 10000000:01000000:1.0:1789265713.038185:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265713.038224:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d50b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265713.038232:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d50b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265713.038243:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d50b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265713.038281:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579082368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265713.038350:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265713.038735:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff937781c42f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265713.053573:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579082368 00000100:00100000:0.0:1789265713.053590:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579082368 00000100:00100000:0.0:1789265713.054759:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789265713.054774:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+22:17141:x1876180579082368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265713.054791:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265713.054810:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937642392800/0xbbfdc9019c1d50b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d50b2 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265713.054837:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642392800/0xbbfdc9019c1d50b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d50b2 expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265713.054855:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937642392800/0xbbfdc9019c1d50b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d50b2 expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265713.054880:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392800, rc 0) 00000100:00100000:0.0:1789265713.054966:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:17141:x1876180579082368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (16615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265713.054972:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789265713.059796:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579082368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265713.059825:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d50b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d50b9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265713.059839:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d50b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d50b9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265713.059947:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f467480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579082496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265713.060006:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265713.060048:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579082496 00000100:00100000:3.0:1789265713.060053:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579082496 00000100:00100000:3.0:1789265713.060097:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789265713.060105:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:17141:x1876180579082496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265713.060219:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:17141:x1876180579082496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265713.060235:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789265713.060280:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377612d4900 going to sleep for 11 seconds 00000100:00100000:3.0:1789265713.060292:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f467480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579082496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265713.060320:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f467480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579082624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265713.061633:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265713.061680:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9377612d4900 going to sleep for 11 seconds 00000100:00100000:0.0:1789265713.061762:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579082624 00000100:00100000:0.0:1789265713.061769:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579082624 00000100:00100000:0.0:1789265713.061819:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789265713.061828:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:17141:x1876180579082624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265713.061962:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:17141:x1876180579082624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265713.061970:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789265713.062813:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f467480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579082624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789265713.066800:0:20219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789265713.067006:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789265713.067031:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265713.067043:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d50b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d50b9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265713.067054:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9377532bc000/0xbbfdc9019c1d50b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d50b9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265713.067064:0:17141:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265713.067067:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93777f58d800 from 13 10000000:01000000:0.0:1789265713.067070:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265713.067107:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392200/0xbbfdc9019c1d50c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265713.067125:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff937642392200/0xbbfdc9019c1d50c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265713.067136:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff937642392200/0xbbfdc9019c1d50c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265713.067159:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579082752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265713.067220:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265713.067256:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f390180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265713.067276:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579082752 00000100:00100000:0.0:1789265713.067282:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579082752 00000100:00100000:0.0:1789265713.067332:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789265713.067340:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+23:17141:x1876180579082752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265713.067353:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265713.067365:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937642392000/0xbbfdc9019c1d50c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbfdc9019c1d50c0 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265713.067387:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937642392000/0xbbfdc9019c1d50c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbbfdc9019c1d50c0 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265713.067396:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937642392000/0xbbfdc9019c1d50c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbbfdc9019c1d50c0 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265713.067404:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392000, rc 0) 00000100:00100000:0.0:1789265713.067454:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:17141:x1876180579082752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265713.067461:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789265713.067514:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579082752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265713.067529:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff937642392200/0xbbfdc9019c1d50c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d50c7 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265713.067538:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff937642392200/0xbbfdc9019c1d50c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbbfdc9019c1d50c7 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265713.067590:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579082880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265713.067616:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265713.067638:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579082880 00000100:00100000:0.0:1789265713.067641:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579082880 00000100:00100000:0.0:1789265713.067663:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789265713.067670:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:17141:x1876180579082880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265713.067771:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:17141:x1876180579082880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265713.067778:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789265713.067797:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f390180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265713.067808:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579082880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265713.067832:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579083008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265713.067899:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265713.067919:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579083008 00000100:00100000:0.0:1789265713.067922:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579083008 00000100:00100000:0.0:1789265713.067940:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789265713.067946:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:17141:x1876180579083008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265713.068014:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:17141:x1876180579083008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265713.068030:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789265713.068059:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f390180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265713.068071:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775285c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:17141:1876180579083008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789265713.069830:0:20220:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789265713.077791:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789265713.077835:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789265713.077848:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff937642392200/0xbbfdc9019c1d50c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d50c7 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265713.077876:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff937642392200/0xbbfdc9019c1d50c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbbfdc9019c1d50c7 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265713.216368:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265713.216479:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556968576 00000100:00100000:3.0:1789265713.216499:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556968576 00000100:00100000:3.0:1789265713.216607:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 163 00000100:00100000:3.0:1789265713.216623:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+11:14918:x1876180556968576:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265713.216645:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265713.216669:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d50ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9195ff expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265713.216706:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d50ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195ff expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265713.216722:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93775181b200/0xbbfdc9019c1d50ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195ff expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265713.216734:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93775181b200, rc 0) 00000100:00100000:3.0:1789265713.216818:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+12:14918:x1876180556968576:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 199us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265713.216842:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 163 00000100:00100000:0.0:1789265713.223155:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265713.223736:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556968704 00000100:00100000:1.0:1789265713.223752:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556968704 00000100:00100000:1.0:1789265713.223832:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 164 00000100:00100000:1.0:1789265713.223841:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+12:14918:x1876180556968704:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265713.224097:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+12:14918:x1876180556968704:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 256us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265713.224104:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 164 00000100:00100000:2.0:1789265713.227725:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265713.235852:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556968832 00000100:00100000:1.0:1789265713.235889:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556968832 00000100:00100000:1.0:1789265713.235948:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 165 00000100:00100000:1.0:1789265713.235958:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+12:14918:x1876180556968832:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265713.236111:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+12:14918:x1876180556968832:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 154us (8396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265713.236128:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 165 00000100:00100000:3.0:1789265713.240849:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265713.249150:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556968960 00000100:00100000:2.0:1789265713.249167:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556968960 00000100:00100000:2.0:1789265713.249234:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 166 00000100:00100000:2.0:1789265713.249245:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+12:14918:x1876180556968960:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265713.249261:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265713.249295:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9377413fd600/0xbbfdc9019c1d50d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919606 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265713.249325:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9377413fd600/0xbbfdc9019c1d50d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919606 expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265713.249336:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9377413fd600/0xbbfdc9019c1d50d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919606 expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265713.249345:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fd600, rc 0) 00000100:00100000:2.0:1789265713.249413:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:14918:x1876180556968960:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 168us (8578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265713.249420:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 166 00000100:00100000:0.0:1789265713.257593:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265713.257639:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556969088 00000100:00100000:0.0:1789265713.257650:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556969088 00000100:00100000:0.0:1789265713.257700:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 167 00000100:00100000:0.0:1789265713.257711:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774798ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:14918:x1876180556969088:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265713.257855:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774798ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:14918:x1876180556969088:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 145us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265713.257896:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 167 00000100:00100000:0.0:1789265713.260245:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265713.264072:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556969216 00000100:00100000:2.0:1789265713.264089:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556969216 00000100:00100000:2.0:1789265713.264150:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 168 00000100:00100000:2.0:1789265713.264162:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:14918:x1876180556969216:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265713.264966:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:14918:x1876180556969216:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 802us (4724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265713.264975:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 168 00000100:00100000:0.0:1789265713.409318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265713.409360:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265713.409470:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556969472 00000100:00100000:2.0:1789265713.409485:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556969472 00000100:00100000:0.0:1789265713.410153:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265713.410721:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556969728 00000100:00100000:1.0:1789265713.410749:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556969728 00000100:00100000:1.0:1789265713.410822:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:1.0:1789265713.410834:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:296b6286-1162-4204-a595-38172c479be3+5:2398:x1876180556969728:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265713.410942:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:296b6286-1162-4204-a595-38172c479be3+5:2398:x1876180556969728:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 110us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265713.410950:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00080000:3.0:1789265713.415955:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265713.415967:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789265713.420721:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556969984 00000100:00100000:2.0:1789265713.420741:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556969984 00000100:00100000:3.0:1789265713.420883:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265713.420929:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265713.420947:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265713.420961:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265713.420978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265713.420998:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556969344 00000100:00100000:3.0:1789265713.421006:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556969344 00000100:00100000:3.0:1789265713.421049:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556969856 00000100:00100000:3.0:1789265713.421052:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556969856 00000100:00100000:3.0:1789265713.421067:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:3.0:1789265713.421076:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+5:2398:x1876180556969472:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265713.421141:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+5:2398:x1876180556969472:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 67us (11839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265713.421149:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:3.0:1789265713.421164:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:0.0:1789265713.421223:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:2.0:1789265713.421234:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556970240 00000100:00100000:2.0:1789265713.421240:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556970240 00000100:00100000:0.0:1789265713.421261:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+6:2398:x1876180556969856:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265713.421274:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556969600 00000100:00100000:2.0:1789265713.421278:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556969600 00000100:00100000:2.0:1789265713.421289:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556970112 00000100:00100000:2.0:1789265713.421305:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556970112 00000100:00100000:2.0:1789265713.421323:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:2.0:1789265713.421329:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937750b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2398:x1876180556970240:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265713.421359:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937750b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2398:x1876180556970240:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265713.421366:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:0.0:1789265713.421455:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+6:2398:x1876180556969856:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 216us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265713.421466:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:3.0:1789265713.421636:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+6:2398:x1876180556969344:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265713.421683:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+6:2398:x1876180556969344:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 512us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265713.421690:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00080000:3.0:1789265713.421718:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789265713.421722:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265713.421725:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265713.421764:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265713.421793:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:3.0:1789265713.421800:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2398:x1876180556969984:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265713.421828:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2398:x1876180556969984:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 29us (11697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265713.421834:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:2.0:1789265713.422103:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:2.0:1789265713.422109:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:296b6286-1162-4204-a595-38172c479be3+5:2398:x1876180556969600:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265713.422135:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:296b6286-1162-4204-a595-38172c479be3+5:2398:x1876180556969600:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 27us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265713.422141:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:2.0:1789265713.422153:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:2.0:1789265713.422160:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f467b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2398:x1876180556970112:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265713.422182:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f467b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2398:x1876180556970112:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265713.422188:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00010000:00010000:0.0:1789265713.850296:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265714.675595:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265714.675630:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579083136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265714.675756:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265714.676109:0:19984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579083136 00000100:00100000:3.0:1789265714.676121:0:19984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579083136 00000100:00100000:3.0:1789265714.676217:0:19984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265714.676229:0:19984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579083136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265714.676266:0:19984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789265714.676335:0:19984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876180579083136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265714.676343:0:19984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789265714.676481:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265714.676613:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876180579083136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265714.867722:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265714.972995:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265714.974911:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556970368 00000100:00100000:3.0:1789265714.974931:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556970368 00000100:00100000:3.0:1789265714.975030:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:3.0:1789265714.975043:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+6:15587:x1876180556970368:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265714.975072:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265714.975099:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d50dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91960d expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975184:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d50e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975201:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d50e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975309:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d50e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975327:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d50ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975335:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d50ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975343:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d50ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975450:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181aa00/0xbbfdc9019c1d50f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975459:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181aa00/0xbbfdc9019c1d50f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975466:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181aa00/0xbbfdc9019c1d50f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265714.975514:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265714.975518:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265714.975567:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93775181aa00/0xbbfdc9019c1d50f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975578:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d50e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975585:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d50e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975602:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d50e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975609:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181ba00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265714.975613:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d50e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975622:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d50e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975637:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93775de3d300) 00010000:00010000:3.0:1789265714.975640:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265714.975645:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d50e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975652:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d50e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975669:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d50ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975675:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d50ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975681:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d50ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975686:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181a400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265714.975690:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d50ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975707:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d50ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975716:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93774e579400) 00010000:00010000:3.0:1789265714.975718:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265714.975720:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d50ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975726:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d50ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975764:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d50dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91960d expref: 8 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975778:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181aa00/0xbbfdc9019c1d50f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91960d expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265714.975785:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93774e579d00) 00010000:00010000:3.0:1789265714.975788:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265714.975790:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93775181aa00, rc 0) 00000100:00100000:3.0:1789265714.977579:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+7:15587:x1876180556970368:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 2523us (4585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265714.977596:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:0.0:1789265714.995478:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265714.995577:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556970496 00000100:00100000:1.0:1789265714.995590:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556970496 00000100:00100000:1.0:1789265714.995662:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:1.0:1789265714.995673:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:296b6286-1162-4204-a595-38172c479be3+7:15587:x1876180556970496:12345-192.168.202.42@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789265714.995778:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:296b6286-1162-4204-a595-38172c479be3+7:15587:x1876180556970496:12345-192.168.202.42@tcp:900:lhsmtool_posix.0 Request processed in 107us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265714.995786:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:0.0:1789265715.009039:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265715.009300:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556970752 00000100:00100000:1.0:1789265715.009314:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556970752 00000100:00100000:1.0:1789265715.009431:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:1.0:1789265715.009456:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+7:15587:x1876180556970752:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265715.009485:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265715.009515:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d50f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919614 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.009640:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d50ff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.009658:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d50ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.009673:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d50ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.009689:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d5106 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.009697:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d5106 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.009705:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d5106 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.009840:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc800/0xbbfdc9019c1d510d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.009850:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc800/0xbbfdc9019c1d510d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.009856:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc800/0xbbfdc9019c1d510d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265715.009908:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789265715.010111:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d50ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.010130:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d50ff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.010138:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d50ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.010145:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bc400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265715.010151:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d50ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.010160:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d50ff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.010176:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93774e579d00) 00010000:00010000:1.0:1789265715.010179:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265715.010185:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d50ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.010193:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d50ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.010210:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d5106 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.010216:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d5106 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.010222:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d5106 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.010229:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bcc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265715.010238:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d5106 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.010246:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d5106 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.010254:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff937742a28900) 00010000:00010000:1.0:1789265715.010256:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265715.010259:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d5106 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.010266:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d5106 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789265715.010766:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789265715.020977:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d50f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919614 expref: 10 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.021013:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc800/0xbbfdc9019c1d510d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919614 expref: 9 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.021024:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff937742a28800) 00010000:00010000:1.0:1789265715.021027:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265715.021031:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc800, rc 0) 00000100:00100000:1.0:1789265715.021120:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+9:15587:x1876180556970752:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 11677us (12094us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789265715.021130:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:2.0:1789265715.025303:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265715.025764:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556970880 00000100:00100000:3.0:1789265715.025778:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556970880 00000100:00100000:3.0:1789265715.025853:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:3.0:1789265715.025972:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+9:15587:x1876180556970880:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789265715.026124:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+9:15587:x1876180556970880:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 Request processed in 156us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265715.037755:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:0.0:1789265715.059782:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265715.059905:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556971008 00000100:00100000:2.0:1789265715.059921:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556971008 00000100:00100000:2.0:1789265715.060020:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:2.0:1789265715.060034:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+5:15587:x1876180556971008:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789265715.060212:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1789265715.067450:0:19934:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7355us 00000100:00100000:2.0:1789265715.085557:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265715.085734:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556971136 00000100:00100000:3.0:1789265715.085749:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556971136 00000100:00100000:3.0:1789265715.085816:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:3.0:1789265715.085828:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+9:15593:x1876180556971136:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265715.085854:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265715.085921:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d511b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91961b expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086010:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d5122 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086028:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d5122 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086042:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d5122 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086059:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5129 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086066:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5129 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086073:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5129 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086124:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d5122 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086140:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d5122 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086148:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d5122 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086155:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181a400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265715.086160:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d5122 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086170:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d5122 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086186:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93775de3d300) 00010000:00010000:3.0:1789265715.086189:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265715.086195:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d5122 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086201:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d5122 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086218:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5129 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086224:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5129 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086230:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5129 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086234:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181ba00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265715.086258:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5129 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086264:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5129 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086272:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93774e579400) 00010000:00010000:3.0:1789265715.086275:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265715.086279:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5129 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086284:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5129 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086322:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d511b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91961b expref: 10 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086334:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93775de3d300) 00010000:00010000:3.0:1789265715.086336:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265715.086340:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d511b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91961b expref: 10 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.086350:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93775181a200, rc 0) 00000100:00100000:3.0:1789265715.086453:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+9:15593:x1876180556971136:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 620us (907us total) trans 0 rc 301/301 00000100:00100000:3.0:1789265715.086462:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:0.0:1789265715.102733:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265715.103142:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556971264 00000100:00100000:2.0:1789265715.103156:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556971264 00000100:00100000:2.0:1789265715.103231:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:2.0:1789265715.103732:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:296b6286-1162-4204-a595-38172c479be3+9:15593:x1876180556971264:12345-192.168.202.42@tcp:700:lfs.0 00000100:00100000:2.0:1789265715.103891:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:296b6286-1162-4204-a595-38172c479be3+9:15593:x1876180556971264:12345-192.168.202.42@tcp:700:lfs.0 Request processed in 650us (2473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265715.103900:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:2.0:1789265715.108028:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+5:15587:x1876180556971008:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 Request processed in 47979us (48244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265715.108048:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:3.0:1789265715.113337:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265715.113439:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556971520 00000100:00100000:1.0:1789265715.113467:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556971520 00000100:00100000:1.0:1789265715.113543:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:1.0:1789265715.113557:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+9:15593:x1876180556971520:12345-192.168.202.42@tcp:36:lfs.0 00010000:00010000:1.0:1789265715.113656:0:17143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265715.113691:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937782162a00/0xbbfdc9019c1d5049 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919588 expref: 9 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.113717:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93775de3d300) 00010000:00010000:1.0:1789265715.113723:0:17143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265715.113804:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.113822:0:17143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d5088 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195f8 expref: 5 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.113831:0:17143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.113904:0:17143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d5088 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195f8 expref: 5 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.113922:0:17143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d5088 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195f8 expref: 5 pid: 17144 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265715.113940:0:17143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1876180579083264:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265715.114046:0:17143:0:(client.c:2715:ptlrpc_set_wait()) set ffff937743431480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265715.119354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265715.119512:0:17143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1876180579083264:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265715.119551:0:17143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265715.119658:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556971648 00000100:00100000:2.0:1789265715.119682:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556971648 00010000:00010000:2.0:1789265715.119746:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d5088 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195f8 expref: 6 pid: 17144 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265715.119790:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:2.0:1789265715.119801:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3745b3d0-dd9e-43a3-937e-965b55464c77+6:2399:x1876180556971648:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265715.119821:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265715.119828:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d5088 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195f8 expref: 6 pid: 17144 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.119842:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d5088 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195f8 expref: 6 pid: 17144 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.119888:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d5088 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9195f8 expref: 6 pid: 17144 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.119924:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93775de3d300) 00010000:00010000:2.0:1789265715.119929:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.119941:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.119949:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.119975:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265715.120034:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2399:x1876180556971648:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 234us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265715.120041:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00010000:00010000:3.0:1789265715.120328:0:17143:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.120346:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.120374:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5137 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.120384:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5137 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.120393:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5137 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789265715.120991:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789265715.124379:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d513e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.124410:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d513e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265715.125683:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265715.126138:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d513e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265715.126185:0:17143:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec300186 reply state 00000000ee6beb18 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d513e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.126202:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d513e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.126211:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93774e579c00) 00010000:00010000:3.0:1789265715.126214:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265715.126219:0:17143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789265715.126226:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789265715.126327:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.126336:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.126344:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.126351:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265715.126356:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.126365:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.126379:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93775de3d300) 00010000:00010000:3.0:1789265715.126382:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265715.126386:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.126393:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d5130 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265715.126420:0:17143:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec300186 reply state 00000000ee6beb18 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5137 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.126439:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5137 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.126888:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93774e579400) 00010000:00010000:3.0:1789265715.126891:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265715.126903:0:17143:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789265715.127077:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+10:15593:x1876180556971520:12345-192.168.202.42@tcp:36:lfs.0 Request processed in 13515us (13745us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789265715.127089:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:0.0:1789265715.280148:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265715.280291:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556971776 00000100:00100000:1.0:1789265715.280324:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556971776 00000100:00100000:1.0:1789265715.280430:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:1.0:1789265715.280453:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+10:15601:x1876180556971776:12345-192.168.202.42@tcp:101:lctl.0 00010000:00010000:1.0:1789265715.280487:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265715.280518:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d5145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919622 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.280607:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d514c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.280626:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d514c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.280640:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d514c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265715.280698:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789265715.280702:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265715.280753:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d514c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.280782:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d5145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919622 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.280806:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bc400/0xbbfdc9019c1d514c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919622 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.280815:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937742a28900) 00010000:00010000:1.0:1789265715.280819:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265715.280823:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377532bc400, rc 0) 00000100:00100000:3.0:1789265715.281712:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+11:15601:x1876180556971776:12345-192.168.202.42@tcp:101:lctl.0 Request processed in 1006us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265715.281723:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:0.0:1789265715.326183:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265715.327227:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556971904 00000100:00100000:3.0:1789265715.327256:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556971904 00000100:00100000:3.0:1789265715.327353:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:3.0:1789265715.327366:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775285df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+5:15602:x1876180556971904:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265715.327392:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265715.327417:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d5153 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.327512:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d515a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.327527:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d515a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.327542:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d515a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265715.327598:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265715.327603:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265715.327627:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d515a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.327656:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d5153 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919629 expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.327700:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ac00/0xbbfdc9019c1d515a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919629 expref: 6 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.327710:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937742a28900) 00010000:00010000:3.0:1789265715.327713:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265715.327717:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93775181ac00, rc 0) 00000100:00100000:3.0:1789265715.327799:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775285df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+6:15602:x1876180556971904:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 437us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265715.327807:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:0.0:1789265715.332631:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265715.332733:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556972032 00000100:00100000:2.0:1789265715.332747:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556972032 00000100:00100000:2.0:1789265715.332822:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:2.0:1789265715.332834:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+6:15602:x1876180556972032:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265715.332903:0:19934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265715.332930:0:19934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc400/0xbbfdc9019c1d5161 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919630 expref: -99 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333016:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d5168 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333034:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d5168 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333049:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d5168 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333078:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d516f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333087:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d516f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333094:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d516f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333201:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fde00/0xbbfdc9019c1d5176 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333210:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fde00/0xbbfdc9019c1d5176 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333218:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fde00/0xbbfdc9019c1d5176 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265715.333266:0:19934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789265715.333270:0:19934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265715.333298:0:19934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fde00/0xbbfdc9019c1d5176 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333311:0:19934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d5168 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333319:0:19934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d5168 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333326:0:19934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d5168 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333342:0:19934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fd200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265715.333347:0:19934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d5168 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333355:0:19934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d5168 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333370:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937742a28900) 00010000:00010000:2.0:1789265715.333373:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265715.333379:0:19934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d5168 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.333386:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d5168 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.334846:0:19934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d516f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.336361:0:19934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d516f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.336372:0:19934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d516f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.336380:0:19934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fc800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265715.336386:0:19934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d516f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.336397:0:19934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d516f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.336467:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93774e579400) 00010000:00010000:2.0:1789265715.336470:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265715.336477:0:19934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d516f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.336485:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d516f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.336566:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc400/0xbbfdc9019c1d5161 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919630 expref: 8 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.336586:0:19934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fde00/0xbbfdc9019c1d5176 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919630 expref: 7 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.336594:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93774e579c00) 00010000:00010000:2.0:1789265715.336596:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265715.336598:0:19934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fde00, rc 0) 00000100:00100000:2.0:1789265715.336706:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+7:15602:x1876180556972032:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 3874us (4089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265715.336717:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:0.0:1789265715.346959:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265715.347072:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556972160 00000100:00100000:1.0:1789265715.347084:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556972160 00000100:00080000:0.0:1789265715.347237:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265715.347452:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:1.0:1789265715.347466:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3745b3d0-dd9e-43a3-937e-965b55464c77+5:15602:x1876180556972160:12345-192.168.202.42@tcp:900:lfs.0 00000100:00100000:1.0:1789265715.347577:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3745b3d0-dd9e-43a3-937e-965b55464c77+5:15602:x1876180556972160:12345-192.168.202.42@tcp:900:lfs.0 Request processed in 114us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265715.347586:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:0.0:1789265715.355971:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265715.356103:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556972416 00000100:00100000:3.0:1789265715.356119:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556972416 00000100:00100000:3.0:1789265715.356191:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00100000:3.0:1789265715.356203:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+7:15602:x1876180556972416:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265715.356230:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265715.356270:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d517d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919637 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265715.356407:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789265715.356568:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d517d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919637 expref: 9 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.356586:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937742a28900) 00010000:00010000:3.0:1789265715.356590:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265715.356595:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d517d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919637 expref: 9 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.356636:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93775181a200, rc 0) 00000100:00100000:3.0:1789265715.356732:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+8:15602:x1876180556972416:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 531us (778us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1789265715.356740:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00100000:0.0:1789265715.360448:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265715.360598:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556972672 00000100:00100000:3.0:1789265715.360613:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556972672 00000100:00100000:3.0:1789265715.360687:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:3.0:1789265715.360699:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3745b3d0-dd9e-43a3-937e-965b55464c77+8:15602:x1876180556972672:12345-192.168.202.42@tcp:36:lfs.0 00010000:00010000:3.0:1789265715.360776:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265715.360815:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fde00/0xbbfdc9019c1d5176 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919630 expref: 8 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.360848:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93774e579c00) 00010000:00010000:3.0:1789265715.360854:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265715.360928:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b400/0xbbfdc9019c1d518b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.360944:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b400/0xbbfdc9019c1d518b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.360956:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b400/0xbbfdc9019c1d518b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265715.361196:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000462344f4 reply state 00000000fb104a08 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b400/0xbbfdc9019c1d518b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.361209:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b400/0xbbfdc9019c1d518b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.361231:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93774e579c00) 00010000:00010000:3.0:1789265715.361233:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789265715.361236:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789265715.361259:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789265715.361354:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3745b3d0-dd9e-43a3-937e-965b55464c77+9:15602:x1876180556972672:12345-192.168.202.42@tcp:36:lfs.0 Request processed in 655us (919us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789265715.361363:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:0.0:1789265715.367941:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265715.368107:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556972928 00000100:00100000:2.0:1789265715.368122:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556972928 00000100:00100000:2.0:1789265715.368207:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:2.0:1789265715.368220:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+9:15602:x1876180556972928:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1789265715.368544:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+10:15602:x1876180556972928:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 325us (618us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789265715.368554:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:0.0:1789265715.383308:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265715.386092:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556973184 00000100:00100000:3.0:1789265715.386116:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556973184 00000100:00100000:3.0:1789265715.386241:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:3.0:1789265715.386257:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+10:15602:x1876180556973184:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265715.386302:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265715.386340:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d5192 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91963e expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.386631:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d5199 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.386658:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d5199 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.386677:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d5199 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.386693:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.386704:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.386746:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265715.386928:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789265715.387019:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d5199 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387028:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d5199 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387035:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d5199 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387041:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181bc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265715.387046:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d5199 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387054:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d5199 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387068:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937742a28900) 00010000:00010000:3.0:1789265715.387071:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265715.387077:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d5199 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387083:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d5199 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387098:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387114:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387120:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387125:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181b800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265715.387128:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387135:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387143:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93774e579400) 00010000:00010000:3.0:1789265715.387146:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265715.387148:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387155:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387195:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d5192 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91963e expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387206:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937742a28900) 00010000:00010000:3.0:1789265715.387208:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265715.387212:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d5192 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91963e expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.387233:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93775181a200, rc 0) 00000100:00100000:3.0:1789265715.387313:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+11:15602:x1876180556973184:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 1058us (4041us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789265715.387320:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:0.0:1789265715.402596:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265715.413607:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556973312 00000100:00100000:3.0:1789265715.413629:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556973312 00000100:00100000:2.0:1789265715.413833:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:2.0:1789265715.413845:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3745b3d0-dd9e-43a3-937e-965b55464c77+11:15602:x1876180556973312:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265715.413915:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265715.413943:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc400/0xbbfdc9019c1d51ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919645 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.414069:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d51b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.414089:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d51b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.414103:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d51b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265715.414136:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789265715.414141:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265715.414168:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d51b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.414203:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc400/0xbbfdc9019c1d51ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919645 expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.414235:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d51b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919645 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.414261:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93774e579c00) 00010000:00010000:2.0:1789265715.414265:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265715.414269:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fc800, rc 0) 00000100:00100000:2.0:1789265715.414368:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3745b3d0-dd9e-43a3-937e-965b55464c77+12:15602:x1876180556973312:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 524us (11786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265715.414396:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:0.0:1789265715.419592:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265715.419755:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556973440 00000100:00100000:2.0:1789265715.419769:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556973440 00000100:00100000:2.0:1789265715.419842:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:2.0:1789265715.419854:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+12:15602:x1876180556973440:12345-192.168.202.42@tcp:37:lfs.0 00000100:00100000:2.0:1789265715.429616:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+12:15602:x1876180556973440:12345-192.168.202.42@tcp:37:lfs.0 Request processed in 9744us (10019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265715.429635:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:0.0:1789265715.435679:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265715.435853:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556973696 00000100:00100000:3.0:1789265715.435917:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556973696 00000100:00100000:3.0:1789265715.436008:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:3.0:1789265715.436020:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93778100b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3745b3d0-dd9e-43a3-937e-965b55464c77+12:15602:x1876180556973696:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1789265715.436320:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93778100b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3745b3d0-dd9e-43a3-937e-965b55464c77+13:15602:x1876180556973696:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 302us (665us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789265715.436330:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00000040:00080000:3.0:1789265715.509172:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789265715.516042:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265715.516171:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556973824 00000100:00100000:1.0:1789265715.516185:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556973824 00000100:00100000:1.0:1789265715.516275:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:1.0:1789265715.516287:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+11:15608:x1876180556973824:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1789265715.516315:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265715.516341:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d51bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91964c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.516442:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d51c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.516461:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d51c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.516475:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d51c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.516488:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d51ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.516496:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d51ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.516524:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d51ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517007:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031e00/0xbbfdc9019c1d51d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517020:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031e00/0xbbfdc9019c1d51d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517028:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031e00/0xbbfdc9019c1d51d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265715.517077:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789265715.517081:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265715.517129:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937740031e00/0xbbfdc9019c1d51d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517144:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d51c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517152:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d51c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517159:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d51c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517165:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377532bd600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265715.517171:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d51c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517180:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d51c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517202:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937742a28900) 00010000:00010000:1.0:1789265715.517206:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265715.517211:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d51c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517218:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bd600/0xbbfdc9019c1d51c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517581:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d51ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517590:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d51ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517596:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d51ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517602:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265715.517606:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d51ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517613:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d51ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517623:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93774e579400) 00010000:00010000:1.0:1789265715.517625:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265715.517629:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d51ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517636:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d51ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517834:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377532bcc00/0xbbfdc9019c1d51bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91964c expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517852:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031e00/0xbbfdc9019c1d51d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91964c expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.517917:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93774e579c00) 00010000:00010000:1.0:1789265715.517920:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789265715.517923:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740031e00, rc 0) 00000100:00100000:1.0:1789265715.518104:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+12:15608:x1876180556973824:12345-192.168.202.42@tcp:101:bash.0 Request processed in 1817us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265715.518115:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:0.0:1789265715.522459:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265715.522733:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556973952 00000100:00100000:2.0:1789265715.522748:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556973952 00000100:00100000:2.0:1789265715.522874:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:2.0:1789265715.522888:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:296b6286-1162-4204-a595-38172c479be3+5:15608:x1876180556973952:12345-192.168.202.42@tcp:900:bash.0 00000100:00100000:2.0:1789265715.523161:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:296b6286-1162-4204-a595-38172c479be3+5:15608:x1876180556973952:12345-192.168.202.42@tcp:900:bash.0 Request processed in 276us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265715.523171:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:0.0:1789265715.526048:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265715.526290:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556974208 00000100:00100000:3.0:1789265715.526304:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556974208 00000100:00100000:3.0:1789265715.526384:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:3.0:1789265715.526396:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+12:15608:x1876180556974208:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1789265715.526540:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265715.526570:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d51d8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919653 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.526732:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.526752:0:17145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d51b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919645 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.526779:0:17145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.526825:0:17145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d51b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919645 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.526840:0:17145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d51b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919645 expref: 12 pid: 17145 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265715.526910:0:17145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f464700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1876180579083392:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265715.527052:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265715.531018:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265715.531188:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556974336 00000100:00100000:1.0:1789265715.531200:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556974336 00010000:00010000:1.0:1789265715.531255:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d51b5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919645 expref: 13 pid: 17145 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265715.531301:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:1.0:1789265715.531313:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+13:2399:x1876180556974336:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265715.531332:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265715.531339:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d51b5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919645 expref: 13 pid: 17145 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.531354:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d51b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919645 expref: 13 pid: 17145 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.531406:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93774e579c00) 00010000:00010000:1.0:1789265715.531487:0:17130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.531501:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.531510:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.531536:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265715.531600:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+13:2399:x1876180556974336:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 289us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265715.531609:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00010000:00010000:3.0:1789265715.531904:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc800/0xbbfdc9019c1d51b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919645 expref: 12 pid: 17145 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265715.533125:0:17145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f464700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1876180579083392:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265715.533164:0:17145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.533177:0:17145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.533184:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.533218:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d51e6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.533232:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d51e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.533276:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d51e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.535551:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d51ed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.535649:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d51ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.535663:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d51ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265715.535679:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789265715.535716:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.535724:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.535732:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.535739:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181b800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265715.535744:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.535753:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.535770:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93774e579c00) 00010000:00010000:3.0:1789265715.535773:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265715.535792:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.535799:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d51df lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265715.535817:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2924f73 reply state 0000000029267d81 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d51e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.535830:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d51e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.535837:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93774e579000) 00010000:00010000:3.0:1789265715.535839:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265715.535843:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789265715.536146:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d51d8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919653 expref: 15 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.536165:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d51ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919653 expref: 14 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.536174:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:3.0:1789265715.536177:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789265715.536179:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93775181ae00, rc 0) 00000100:00100000:3.0:1789265715.536360:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+15:15608:x1876180556974208:12345-192.168.202.42@tcp:101:bash.0 Request processed in 9964us (10325us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789265715.536370:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:0.0:1789265715.549046:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265715.549233:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556974464 00000100:00100000:3.0:1789265715.549260:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556974464 00000100:00100000:3.0:1789265715.549335:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:3.0:1789265715.549349:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+15:15608:x1876180556974464:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1789265715.549401:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265715.549448:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d51fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91965a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.549543:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d5202 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.549562:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d5202 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.549575:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d5202 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265715.549644:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789265715.549649:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265715.549674:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d5202 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.549686:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d5202 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.549717:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d51fb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91965a expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.549740:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d5202 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91965a expref: 16 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.549750:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:3.0:1789265715.549754:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265715.549758:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93775181b800, rc 0) 00000100:00100000:3.0:1789265715.549849:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+16:15608:x1876180556974464:12345-192.168.202.42@tcp:101:bash.0 Request processed in 502us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265715.550066:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:0.0:1789265715.554546:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265715.554729:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556974720 00000100:00100000:2.0:1789265715.554743:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556974720 00000100:00100000:2.0:1789265715.554815:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:2.0:1789265715.554827:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:296b6286-1162-4204-a595-38172c479be3+16:15608:x1876180556974720:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:2.0:1789265715.555263:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:296b6286-1162-4204-a595-38172c479be3+17:15608:x1876180556974720:12345-192.168.202.42@tcp:35:bash.0 Request processed in 436us (731us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789265715.555272:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:0.0:1789265715.660169:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265715.660465:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556974976 00000100:00100000:3.0:1789265715.660481:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556974976 00000100:00100000:3.0:1789265715.660571:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:3.0:1789265715.660585:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+17:15618:x1876180556974976:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1789265715.660624:0:19934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265715.660654:0:19934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d5209 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919661 expref: -99 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265715.660795:0:19934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789265715.661016:0:19934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d5209 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919661 expref: 19 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.661034:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937742a28900) 00010000:00010000:3.0:1789265715.661038:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265715.661043:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d5209 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919661 expref: 19 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.661060:0:19934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93775181a200, rc 0) 00000100:00100000:3.0:1789265715.661126:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+18:15618:x1876180556974976:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 545us (970us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789265715.661134:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:0.0:1789265715.668495:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265715.668618:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556975232 00000100:00100000:2.0:1789265715.668632:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556975232 00000100:00100000:2.0:1789265715.668707:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:2.0:1789265715.668739:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:296b6286-1162-4204-a595-38172c479be3+18:15618:x1876180556975232:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1789265715.669064:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:296b6286-1162-4204-a595-38172c479be3+19:15618:x1876180556975232:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 328us (586us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789265715.669073:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:0.0:1789265715.696845:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265715.696950:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556975488 00000100:00100000:2.0:1789265715.696963:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556975488 00000100:00100000:2.0:1789265715.697027:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:2.0:1789265715.697038:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+19:15621:x1876180556975488:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1789265715.697069:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265715.697092:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc400/0xbbfdc9019c1d5217 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919668 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.697214:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d521e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.697228:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d521e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.697391:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d521e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265715.697405:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789265715.697546:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc400/0xbbfdc9019c1d5217 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919668 expref: 22 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.697588:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d521e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919668 expref: 21 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265715.697622:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:2.0:1789265715.697624:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265715.697628:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fd200, rc 0) 00000100:00100000:2.0:1789265715.697749:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+21:15621:x1876180556975488:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 712us (915us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789265715.697755:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:1.0:1789265715.700963:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579083520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265715.701048:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265715.701165:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579083520 00000100:00100000:0.0:1789265715.701175:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579083520 00000100:00100000:0.0:1789265715.701258:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265715.701270:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579083520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265715.701299:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789265715.701355:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579083520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265715.701363:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789265715.701445:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265715.701505:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579083520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265715.701667:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265715.701676:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579083648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265715.701708:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265715.702076:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579083648 00000100:00100000:3.0:1789265715.702083:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579083648 00000100:00100000:3.0:1789265715.702132:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789265715.702141:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579083648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265715.702195:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265715.702240:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579083648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265715.702248:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265715.702445:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579083648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265715.702457:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265715.702470:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579083776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265715.702517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265715.702535:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579083776 00000100:00100000:0.0:1789265715.702539:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579083776 00000100:00100000:0.0:1789265715.702580:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265715.702587:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579083776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265715.702608:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789265715.702970:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579083776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 382us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265715.702977:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789265715.703808:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579083776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265715.704931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265715.705093:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556975616 00000100:00100000:1.0:1789265715.705104:0:17898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556975616 00000100:00100000:1.0:1789265715.705169:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:1.0:1789265715.705180:0:17898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:296b6286-1162-4204-a595-38172c479be3+21:2397:x1876180556975616:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265715.705213:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265715.705258:0:17898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd200/0xbbfdc9019c1d521e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919668 expref: 21 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.705289:0:17898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:1.0:1789265715.705294:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265715.705361:0:17898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:296b6286-1162-4204-a595-38172c479be3+20:2397:x1876180556975616:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 182us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265715.705369:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:0.0:1789265715.707306:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265715.707748:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556975744 00000100:00100000:3.0:1789265715.707760:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556975744 00000100:00100000:3.0:1789265715.707829:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:3.0:1789265715.707840:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+20:15621:x1876180556975744:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:3.0:1789265715.708074:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d522c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.708097:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d522c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.708113:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d522c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.708162:0:19934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d522c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.708171:0:19934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d522c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.708179:0:19934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d522c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.708186:0:19934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181a200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:3.0:1789265715.708191:0:19934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d522c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.708220:0:19934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d522c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.708244:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:3.0:1789265715.708248:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265715.708253:0:19934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d522c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265715.708259:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d522c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265715.708344:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+20:15621:x1876180556975744:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 506us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265715.708353:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:0.0:1789265715.711437:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265715.711571:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556976000 00000100:00100000:2.0:1789265715.711585:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556976000 00000100:00100000:2.0:1789265715.711665:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:2.0:1789265715.711677:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:296b6286-1162-4204-a595-38172c479be3+20:15621:x1876180556976000:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1789265715.712199:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:296b6286-1162-4204-a595-38172c479be3+21:15621:x1876180556976000:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 523us (784us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789265715.712207:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00010000:00010000:0.0:1789265715.897716:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265715.942041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265715.942117:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556976256 00000100:00100000:1.0:1789265715.942131:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556976256 00000100:00100000:1.0:1789265715.942212:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:1.0:1789265715.942225:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+21:15652:x1876180556976256:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:1.0:1789265715.942256:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265715.942285:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d5233 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91966f expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.942587:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d523a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.942606:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d523a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.942620:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d523a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265715.942634:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789265715.942800:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d5233 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91966f expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.942837:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d523a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91966f expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.942849:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:1.0:1789265715.942853:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265715.942857:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740031000, rc 0) 00000100:00100000:1.0:1789265715.942993:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+23:15652:x1876180556976256:12345-192.168.202.42@tcp:101:cat.0 Request processed in 770us (963us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789265715.943002:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:0.0:1789265715.947286:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265715.947396:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265715.947451:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556976640 00000100:00100000:1.0:1789265715.947466:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556976640 00000100:00100000:1.0:1789265715.947559:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:1.0:1789265715.947585:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:296b6286-1162-4204-a595-38172c479be3+23:2399:x1876180556976640:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265715.947607:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265715.947642:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d523a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91966f expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265715.947668:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:1.0:1789265715.947674:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265715.947748:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:296b6286-1162-4204-a595-38172c479be3+22:2399:x1876180556976640:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 168us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265715.947757:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:3.0:1789265715.947907:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556976512 00000100:00100000:3.0:1789265715.947913:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556976512 00000100:00100000:3.0:1789265715.947956:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:3.0:1789265715.947972:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:296b6286-1162-4204-a595-38172c479be3+22:15652:x1876180556976512:12345-192.168.202.42@tcp:35:cat.0 00000100:00100000:3.0:1789265715.948398:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:296b6286-1162-4204-a595-38172c479be3+23:15652:x1876180556976512:12345-192.168.202.42@tcp:35:cat.0 Request processed in 433us (1125us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789265715.948407:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:0.0:1789265716.016026:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.019544:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556976896 00000100:00100000:2.0:1789265716.019569:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556976896 00000100:00100000:2.0:1789265716.019676:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:2.0:1789265716.019690:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+23:15658:x1876180556976896:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:2.0:1789265716.019724:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265716.019752:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc400/0xbbfdc9019c1d5248 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919676 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.019964:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd800/0xbbfdc9019c1d524f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.019982:0:17145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d51ed lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919653 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.019992:0:17145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d5202 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91965a expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.020000:0:17145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd800/0xbbfdc9019c1d524f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.020040:0:17145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d5202 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91965a expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.020054:0:17145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d5202 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91965a expref: 24 pid: 17144 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265716.020069:0:17145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc27480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1876180579083904:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265716.020187:0:17145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d51ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919653 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.020196:0:17145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d51ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919653 expref: 24 pid: 17145 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265716.020206:0:17145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc25180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1876180579084032:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265716.020238:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff9376422f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265716.023213:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265716.023277:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.023335:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556977024 00000100:00100000:2.0:1789265716.023350:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556977024 00000100:00100000:3.0:1789265716.023400:0:17145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc27480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1876180579083904:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265716.023405:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d5202 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91965a expref: 25 pid: 17144 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265716.023431:0:17145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc25180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1876180579084032:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265716.023464:0:17145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd800/0xbbfdc9019c1d524f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265716.023465:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556977152 00000100:00100000:2.0:1789265716.023471:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556977152 00010000:00010000:2.0:1789265716.023488:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d51ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919653 expref: 26 pid: 17145 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265716.023517:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:2.0:1789265716.023528:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:296b6286-1162-4204-a595-38172c479be3+26:2399:x1876180556977024:12345-192.168.202.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789265716.023534:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00010000:00010000:2.0:1789265716.023550:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789265716.023556:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377434a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:296b6286-1162-4204-a595-38172c479be3+26:2399:x1876180556977152:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265716.023561:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d5202 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91965a expref: 26 pid: 17144 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.023569:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265716.023578:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d5202 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91965a expref: 26 pid: 17144 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.023580:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d51ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919653 expref: 26 pid: 17145 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.023687:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b800/0xbbfdc9019c1d5202 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91965a expref: 26 pid: 17144 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.025828:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d51ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919653 expref: 25 pid: 17145 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.025881:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d51ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919653 expref: 25 pid: 17145 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.025905:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:3.0:1789265716.025912:0:17130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd800/0xbbfdc9019c1d524f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.025924:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd800/0xbbfdc9019c1d524f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.025933:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd800/0xbbfdc9019c1d524f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.026075:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265716.026161:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377434a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:296b6286-1162-4204-a595-38172c479be3+24:2399:x1876180556977152:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 2607us (2881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265716.026173:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00010000:00010000:1.0:1789265716.026404:0:17145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd800/0xbbfdc9019c1d524f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.026479:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd800/0xbbfdc9019c1d524f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265716.026741:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789265716.027296:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:2.0:1789265716.027305:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265716.027408:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:296b6286-1162-4204-a595-38172c479be3+25:2399:x1876180556977024:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 3878us (4207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265716.027429:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00010000:00010000:1.0:1789265716.027438:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc400/0xbbfdc9019c1d5248 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919676 expref: 25 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.027477:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd800/0xbbfdc9019c1d524f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919676 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.027755:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:1.0:1789265716.027759:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265716.027762:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fd800, rc 0) 00000100:00100000:1.0:1789265716.027793:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+23:15658:x1876180556976896:12345-192.168.202.42@tcp:101:dd.0 Request processed in 8107us (11784us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1789265716.027801:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:0.0:1789265716.031553:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.035210:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556977280 00000100:00100000:2.0:1789265716.035231:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556977280 00000100:00100000:1.0:1789265716.035349:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:1.0:1789265716.035367:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+23:15658:x1876180556977280:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:1.0:1789265716.035403:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265716.035449:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d525d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91967d expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.035929:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d5264 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.035949:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d5264 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.035965:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d5264 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.036132:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d525d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91967d expref: 25 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.036152:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d5264 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91967d expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.036162:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:1.0:1789265716.036165:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265716.036170:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740030000, rc 0) 00000100:00100000:1.0:1789265716.036265:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+24:15658:x1876180556977280:12345-192.168.202.42@tcp:101:dd.0 Request processed in 903us (4725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265716.036273:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:0.0:1789265716.039459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265716.040043:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556977536 00000100:00100000:3.0:1789265716.040061:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556977536 00000100:00100000:3.0:1789265716.040181:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:3.0:1789265716.040194:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+24:15658:x1876180556977536:12345-192.168.202.42@tcp:36:dd.0 00010000:00010000:3.0:1789265716.040541:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d526b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.040564:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d526b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.040579:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d526b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265716.040637:0:19934:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789265716.040664:0:19934:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e3de042 reply state 00000000f515847a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d526b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.040679:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d526b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.040687:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:3.0:1789265716.040691:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265716.040695:0:19934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265716.040809:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+27:15658:x1876180556977536:12345-192.168.202.42@tcp:36:dd.0 Request processed in 617us (1363us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789265716.040817:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 45 00000020:00080000:3.0:1789265716.040824:0:19934:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789265716.042922:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.043312:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556977664 00000100:00100000:2.0:1789265716.043327:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556977664 00000100:00100000:2.0:1789265716.043404:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:2.0:1789265716.043427:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+27:15658:x1876180556977664:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:2.0:1789265716.043462:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265716.043491:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fda00/0xbbfdc9019c1d5272 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919684 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.043580:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fda00/0xbbfdc9019c1d5272 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919684 expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.043598:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fda00/0xbbfdc9019c1d5272 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919684 expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.043621:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:2.0:1789265716.043625:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789265716.043629:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fda00, rc 0) 00000100:00100000:2.0:1789265716.043701:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+28:15658:x1876180556977664:12345-192.168.202.42@tcp:101:dd.0 Request processed in 287us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265716.043710:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:0.0:1789265716.054249:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.054402:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556977920 00000100:00100000:2.0:1789265716.054435:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556977920 00000100:00100000:2.0:1789265716.054568:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:2.0:1789265716.054580:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:296b6286-1162-4204-a595-38172c479be3+28:15658:x1876180556977920:12345-192.168.202.42@tcp:103:dd.0 00010000:00010000:2.0:1789265716.054603:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265716.054633:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fda00/0xbbfdc9019c1d5272 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919684 expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.054687:0:17131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:2.0:1789265716.054693:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265716.054767:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:296b6286-1162-4204-a595-38172c479be3+27:15658:x1876180556977920:12345-192.168.202.42@tcp:103:dd.0 Request processed in 189us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265716.054775:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:0.0:1789265716.057621:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265716.057748:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556978048 00000100:00100000:1.0:1789265716.057763:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556978048 00000100:00100000:1.0:1789265716.057906:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:1.0:1789265716.057918:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+27:15658:x1876180556978048:12345-192.168.202.42@tcp:58:dd.0 00010000:00010000:1.0:1789265716.058081:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d5279 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.058104:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d5279 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.058118:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d5279 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265716.059520:0:17145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265716.059807:0:17145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1789265716.060018:0:17145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1789265716.060216:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+27:15658:x1876180556978048:12345-192.168.202.42@tcp:58:dd.0 Request processed in 2294us (2602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265716.060228:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:0.0:1789265716.063050:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265716.063147:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556978176 00000100:00100000:1.0:1789265716.063160:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556978176 00000100:00100000:1.0:1789265716.063265:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:1.0:1789265716.063277:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+27:15658:x1876180556978176:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:1.0:1789265716.063305:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265716.063332:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031200/0xbbfdc9019c1d5280 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d91968b expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.063423:0:17143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d5279 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.063436:0:17143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740031200/0xbbfdc9019c1d5280 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91968b expref: 28 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.063462:0:17143:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d5279 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.063481:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031200/0xbbfdc9019c1d5280 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91968b expref: 28 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.063498:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:1.0:1789265716.063502:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265716.063506:0:17143:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff937740031200/0xbbfdc9019c1d5280 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91968b expref: 28 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.063515:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740031200, rc 0) 00000100:00100000:1.0:1789265716.063605:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+28:15658:x1876180556978176:12345-192.168.202.42@tcp:101:dd.0 Request processed in 331us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265716.063613:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 48 00000040:00080000:0.0:1789265716.148202:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789265716.148220:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265716.148287:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789265716.148298:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789265716.148499:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775182f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17179:1876180579084160:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265716.148628:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f390e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265716.156155:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.156330:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556978304 00000100:00100000:2.0:1789265716.156343:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556978304 00000100:00100000:2.0:1789265716.156447:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:2.0:1789265716.156461:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+29:15659:x1876180556978304:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789265716.156516:0:19934:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265716.156547:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775182f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17179:1876180579084160:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789265716.156666:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+28:15659:x1876180556978304:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 207us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265716.156674:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:2.0:1789265716.163030:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265716.164554:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556978432 00000100:00100000:0.0:1789265716.164572:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556978432 00000100:00100000:0.0:1789265716.164661:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:0.0:1789265716.164671:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+28:15659:x1876180556978432:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789265716.164763:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393e00/0xbbfdc9019c1d5287 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.164780:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393e00/0xbbfdc9019c1d5287 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.164792:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393e00/0xbbfdc9019c1d5287 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.164806:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d528e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.164832:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d528e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.164837:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d528e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.164896:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d5295 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.164906:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d5295 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.164914:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d5295 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265716.164971:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789265716.164976:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265716.164994:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d5295 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165007:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393e00/0xbbfdc9019c1d5287 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165015:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393e00/0xbbfdc9019c1d5287 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165024:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393e00/0xbbfdc9019c1d5287 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165030:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393e00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265716.165034:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393e00/0xbbfdc9019c1d5287 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165046:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393e00/0xbbfdc9019c1d5287 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165058:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff937742a28800) 00010000:00010000:0.0:1789265716.165060:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265716.165065:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393e00/0xbbfdc9019c1d5287 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165069:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393e00/0xbbfdc9019c1d5287 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165083:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d528e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165086:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d528e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165089:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d528e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165093:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642392a00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265716.165095:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d528e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165098:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d528e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165102:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff93774712f400) 00010000:00010000:0.0:1789265716.165103:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265716.165104:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d528e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165114:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d528e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165126:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d5295 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165130:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d5295 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165134:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d5295 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165137:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937642393800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265716.165138:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d5295 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165142:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d5295 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165145:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:0.0:1789265716.165146:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265716.165148:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d5295 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.165151:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642393800/0xbbfdc9019c1d5295 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265716.165257:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+28:15659:x1876180556978432:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 Request processed in 586us (2243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265716.165265:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:0.0:1789265716.168720:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.169482:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556978688 00000100:00100000:2.0:1789265716.169499:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556978688 00000100:00100000:2.0:1789265716.169627:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:2.0:1789265716.169641:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+28:15659:x1876180556978688:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265716.169670:0:19934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265716.169696:0:19934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fdc00/0xbbfdc9019c1d529c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919692 expref: -99 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.169840:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fcc00/0xbbfdc9019c1d52a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.169900:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fcc00/0xbbfdc9019c1d52a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.169942:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fcc00/0xbbfdc9019c1d52a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265716.169958:0:19934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789265716.170075:0:19934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fcc00/0xbbfdc9019c1d52a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.170083:0:19934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fcc00/0xbbfdc9019c1d52a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.170090:0:19934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fcc00/0xbbfdc9019c1d52a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.170096:0:19934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fcc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265716.170101:0:19934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fcc00/0xbbfdc9019c1d52a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.170109:0:19934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fcc00/0xbbfdc9019c1d52a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.170125:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:2.0:1789265716.170128:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789265716.170134:0:19934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fcc00/0xbbfdc9019c1d52a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.170139:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fcc00/0xbbfdc9019c1d52a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.170220:0:19934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fdc00/0xbbfdc9019c1d529c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919692 expref: 30 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.170246:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff937742a28800) 00010000:00010000:2.0:1789265716.170248:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265716.170253:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fdc00/0xbbfdc9019c1d529c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919692 expref: 30 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.170267:0:19934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fdc00, rc 0) 00000100:00100000:2.0:1789265716.170364:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+29:15659:x1876180556978688:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 726us (1658us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789265716.170372:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:3.0:1789265716.174810:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265716.174954:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556978816 00000100:00100000:1.0:1789265716.174977:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556978816 00000100:00100000:1.0:1789265716.175059:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:1.0:1789265716.175072:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+29:15659:x1876180556978816:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789265716.175124:0:17144:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789265716.175571:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+29:15659:x1876180556978816:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 499us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265716.175580:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:0.0:1789265716.184315:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.184842:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556979072 00000100:00100000:2.0:1789265716.184880:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556979072 00000100:00100000:2.0:1789265716.184983:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:2.0:1789265716.184997:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+29:15659:x1876180556979072:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265716.185029:0:19934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265716.185058:0:19934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc000/0xbbfdc9019c1d52b1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d919699 expref: -99 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789265716.185676:0:19934:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:2.0:1789265716.185686:0:19934:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789265716.185713:0:19934:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789265716.185950:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fca00/0xbbfdc9019c1d52b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.185969:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fca00/0xbbfdc9019c1d52b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.185982:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fca00/0xbbfdc9019c1d52b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.186075:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc000/0xbbfdc9019c1d52b1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919699 expref: 32 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.186109:0:19934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fca00/0xbbfdc9019c1d52b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919699 expref: 31 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.186120:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93775de3d500) 00010000:00010000:2.0:1789265716.186123:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265716.186127:0:19934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fca00, rc 0) 00000100:00100000:2.0:1789265716.186214:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+31:15659:x1876180556979072:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 1220us (1916us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789265716.186222:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:3.0:1789265716.192122:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265716.192900:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556979328 00000100:00100000:0.0:1789265716.192914:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556979328 00000100:00100000:0.0:1789265716.193005:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:0.0:1789265716.193018:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+31:15659:x1876180556979328:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789265716.193094:0:17143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265716.193128:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fca00/0xbbfdc9019c1d52b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d919699 expref: 31 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.193164:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93775de3d500) 00010000:00010000:0.0:1789265716.193178:0:17143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265716.193782:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52c6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.193804:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.193817:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.193835:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc200/0xbbfdc9019c1d52cd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x78dffa8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.193841:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc200/0xbbfdc9019c1d52cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x78dffa8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.193847:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc200/0xbbfdc9019c1d52cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x78dffa8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.194123:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.194131:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52c6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.194139:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.194151:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fd000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265716.194157:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.194166:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52c6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.194178:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93774e579c00) 00010000:00010000:2.0:1789265716.194181:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265716.194187:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52c6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.194325:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52c6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.194355:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc200/0xbbfdc9019c1d52cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x78dffa8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.194361:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc200/0xbbfdc9019c1d52cd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x78dffa8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.194368:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc200/0xbbfdc9019c1d52cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x78dffa8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.194381:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fc200 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:2.0:1789265716.194384:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc200/0xbbfdc9019c1d52cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x78dffa8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.194389:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc200/0xbbfdc9019c1d52cd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x78dffa8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.194399:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x78dffa8f (ffff93775de3d000) 00010000:00010000:2.0:1789265716.194401:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265716.194403:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc200/0xbbfdc9019c1d52cd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x78dffa8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.194501:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fc200/0xbbfdc9019c1d52cd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x78dffa8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265716.194794:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+30:15659:x1876180556979328:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 1772us (2682us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265716.194805:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:0.0:1789265716.202076:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265716.202902:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556979456 00000100:00100000:1.0:1789265716.202918:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556979456 00000100:00100000:1.0:1789265716.202999:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:1.0:1789265716.203012:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+30:15659:x1876180556979456:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265716.203040:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265716.203072:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d52d4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9196a0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.203119:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d52db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.203136:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d52db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.203152:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d52db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.203314:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d52d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196a0 expref: 32 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.203339:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031600/0xbbfdc9019c1d52db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196a0 expref: 31 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.203348:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff937742a28c00) 00010000:00010000:1.0:1789265716.203352:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265716.203356:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740031600, rc 0) 00000100:00100000:1.0:1789265716.203453:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+31:15659:x1876180556979456:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 443us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265716.203460:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:1.0:1789265716.206987:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.208438:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556979712 00000100:00100000:2.0:1789265716.208457:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556979712 00000100:00100000:2.0:1789265716.208552:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:2.0:1789265716.208563:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+31:15659:x1876180556979712:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265716.208680:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52e2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.208696:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.208708:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265716.208978:0:19934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789265716.208990:0:19934:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 571870129474ns, next at 572870126331ns, rc = 0 00000004:00010000:2.0:1789265716.209068:0:19934:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca06ee88 reply state 00000000b6c932fa transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.209083:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.209091:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff937742a28c00) 00010000:00010000:2.0:1789265716.209095:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789265716.209099:0:19934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265716.209222:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+33:15659:x1876180556979712:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 658us (2248us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789265716.209230:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:0.0:1789265716.211163:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579084416:0@lo:400:kworker.0 00000100:00100000:3.0:1789265716.211242:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579084672:0@lo:400:kworker.0 00000100:00100000:3.0:1789265716.211317:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265716.211355:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180579085184:0@lo:400:kworker.0 00000100:00100000:3.0:1789265716.211398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265716.211433:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789265716.211438:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579084288:0@lo:400:kworker.0 00000100:00100000:3.0:1789265716.211466:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265716.211506:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579084800:0@lo:400:kworker.0 00000100:00100000:3.0:1789265716.211528:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265716.211545:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180579085312:0@lo:400:kworker.0 00000100:00100000:3.0:1789265716.211562:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265716.211594:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579084800 00000100:00100000:3.0:1789265716.211601:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579084800 00000100:00100000:3.0:1789265716.211657:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265716.211667:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579084800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265716.211715:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579084800:12345-0@lo:400:kworker.0 Request processed in 50us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265716.211723:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265716.211770:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579084800:0@lo:400:kworker.0 00000100:00080000:1.0:1789265716.211987:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265716.212002:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579084672 00000100:00100000:1.0:1789265716.212005:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579084672 00000100:00100000:1.0:1789265716.212031:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579085184 00000100:00100000:1.0:1789265716.212033:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579085184 00000100:00080000:1.0:1789265716.212046:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265716.212056:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579085312 00000100:00100000:1.0:1789265716.212058:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579085312 00000100:00080000:1.0:1789265716.212066:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265716.212077:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265716.212083:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579084672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265716.212121:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876180579084672:12345-0@lo:400:kworker.0 Request processed in 38us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265716.212128:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265716.212162:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876180579084672:0@lo:400:kworker.0 00000100:00100000:1.0:1789265716.212178:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265716.212184:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180579085184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265716.212214:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876180579085184:12345-0@lo:400:kworker.0 Request processed in 30us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265716.212220:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1789265716.212242:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9377507a3480 x1876180579085184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265716.212252:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876180579085184:0@lo:400:kworker.0 00000100:00100000:1.0:1789265716.212269:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789265716.212275:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180579085312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265716.212305:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876180579085312:12345-0@lo:400:kworker.0 Request processed in 30us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265716.212312:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789265716.212334:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876180579085312:0@lo:400:kworker.0 00000100:00100000:0.0:1789265716.213216:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265716.213266:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180579084928:0@lo:400:kworker.0 00000100:00100000:0.0:1789265716.213299:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265716.213330:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180579085440:0@lo:400:kworker.0 00000100:00100000:0.0:1789265716.213353:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265716.213383:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789265716.213390:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579084544:0@lo:400:kworker.0 00000100:00100000:0.0:1789265716.213432:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265716.213448:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180579085056:0@lo:400:kworker.0 00000100:00100000:0.0:1789265716.213469:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265716.213478:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9377507a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579085568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265716.213485:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579084928 00000100:00100000:2.0:1789265716.213505:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579084928 00000100:00100000:0.0:1789265716.213528:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265716.213546:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579085440 00000100:00100000:2.0:1789265716.213549:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579085440 00000100:00100000:2.0:1789265716.213572:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579085056 00000100:00100000:2.0:1789265716.213575:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579085056 00000100:00100000:0.0:1789265716.213581:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579084288 00000100:00100000:0.0:1789265716.213585:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579084288 00000100:00100000:2.0:1789265716.213593:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789265716.213599:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180579084928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265716.213617:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789265716.213623:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:3645:x1876180579084288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265716.213654:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180579084928:12345-0@lo:400:kworker.0 Request processed in 55us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265716.213655:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c753e2cb-2e3c-4466-8bdc-141f9ba53a83+24:3645:x1876180579084288:12345-0@lo:400:kworker.0 Request processed in 32us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265716.213662:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789265716.213662:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789265716.213677:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789265716.213683:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180579085440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265716.213709:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180579085440:12345-0@lo:400:kworker.0 Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265716.213722:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789265716.213733:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265716.213737:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180579085056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265716.213738:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579085568 00000100:00100000:0.0:1789265716.213741:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579085568 00000100:00100000:2.0:1789265716.213765:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180579085056:12345-0@lo:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265716.213770:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265716.213771:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789265716.213777:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579085568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265716.213804:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265716.213838:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579085568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265716.213845:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265716.213900:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265716.213911:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643d13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579085696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265716.213938:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265716.213963:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579085696 00000100:00100000:0.0:1789265716.213967:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579085696 00000100:00100000:0.0:1789265716.213989:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265716.213995:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579085696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265716.214005:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265716.214030:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876180579085696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265716.214035:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789265716.214077:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643d13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876180579085696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265716.214110:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180579085056:0@lo:400:kworker.0 00000100:00100000:0.0:1789265716.214124:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579085568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265716.214133:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180579084928:0@lo:400:kworker.0 00010000:00080000:0.0:1789265716.214146:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9377507a1500 x1876180579085440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265716.214157:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9377507a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180579085440:0@lo:400:kworker.0 00000100:00100000:1.0:1789265716.215469:0:19187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579084416 00000100:00100000:1.0:1789265716.215487:0:19187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579084416 00000100:00100000:1.0:1789265716.215566:0:19187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579084544 00000100:00100000:1.0:1789265716.215570:0:19187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579084544 00000100:00100000:1.0:1789265716.215600:0:19187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789265716.215610:0:19187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579084416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265716.215716:0:19187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579084416:12345-0@lo:400:kworker.0 Request processed in 107us (2502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265716.215724:0:19187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789265716.215743:0:19187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265716.215766:0:19187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775182ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579084544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265716.215801:0:19187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775182ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579084544:12345-0@lo:400:kworker.0 Request processed in 37us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265716.215808:0:19187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789265716.215837:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265716.215842:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265716.215846:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265716.215849:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265716.215946:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579084544:0@lo:400:kworker.0 00000100:00100000:1.0:1789265716.216193:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579084416:0@lo:400:kworker.0 00000100:00100000:1.0:1789265716.216270:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f3e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c753e2cb-2e3c-4466-8bdc-141f9ba53a83:3645:1876180579084288:0@lo:400:kworker.0 00000100:00100000:2.0:1789265716.219391:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265716.219477:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556979840 00000100:00100000:0.0:1789265716.219493:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556979840 00000100:00100000:0.0:1789265716.219633:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:0.0:1789265716.219647:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+33:15659:x1876180556979840:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265716.219681:0:19934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265716.219710:0:19934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d52e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9196a7 expref: -99 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.219786:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d52e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196a7 expref: 34 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.219805:0:19934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d52e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196a7 expref: 34 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.219830:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff937742a28c00) 00010000:00010000:0.0:1789265716.219833:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265716.219838:0:19934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937642392a00, rc 0) 00000100:00100000:0.0:1789265716.220222:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+34:15659:x1876180556979840:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 577us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265716.220261:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:1.0:1789265716.224654:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.225484:0:19187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556979968 00000100:00100000:2.0:1789265716.225499:0:19187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556979968 00000100:00080000:1.0:1789265716.225562:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265716.225602:0:19187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:2.0:1789265716.225614:0:19187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:296b6286-1162-4204-a595-38172c479be3+5:2399:x1876180556979968:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789265716.225938:0:19187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:296b6286-1162-4204-a595-38172c479be3+6:2399:x1876180556979968:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 325us (1299us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789265716.225946:0:19187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:1.0:1789265716.230460:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.230584:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556980224 00000100:00100000:2.0:1789265716.230600:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556980224 00000100:00100000:2.0:1789265716.230680:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:2.0:1789265716.230694:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:296b6286-1162-4204-a595-38172c479be3+34:15659:x1876180556980224:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789265716.231048:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:296b6286-1162-4204-a595-38172c479be3+35:15659:x1876180556980224:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 356us (601us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789265716.231056:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:1.0:1789265716.234837:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265716.235485:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556980480 00000100:00100000:0.0:1789265716.235515:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556980480 00000100:00100000:0.0:1789265716.235614:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:0.0:1789265716.235628:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+35:15659:x1876180556980480:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789265716.235793:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+35:15659:x1876180556980480:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 168us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265716.235802:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:1.0:1789265716.240714:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265716.240826:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556980608 00000100:00100000:3.0:1789265716.240840:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556980608 00000100:00100000:3.0:1789265716.240976:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:3.0:1789265716.240990:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+35:15659:x1876180556980608:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265716.241017:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265716.241044:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d52f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9196ae expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.241142:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d52f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.241186:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d52f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.241200:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d52f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265716.241272:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265716.241299:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d52f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.241334:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a200/0xbbfdc9019c1d52f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196ae expref: 37 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.241358:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d52f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196ae expref: 36 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.241369:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff937742a28c00) 00010000:00010000:3.0:1789265716.241373:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789265716.241377:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93775181a600, rc 0) 00000100:00100000:3.0:1789265716.241474:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+36:15659:x1876180556980608:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 487us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265716.241482:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:1.0:1789265716.246757:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265716.247387:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556980736 00000100:00100000:3.0:1789265716.247401:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556980736 00000100:00100000:2.0:1789265716.247583:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:2.0:1789265716.247599:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:296b6286-1162-4204-a595-38172c479be3+6:2400:x1876180556980736:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265716.247624:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265716.247675:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec0690ee/0xbbfdc9019c1d52fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9196b5 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265716.247714:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa60735, blocks: 0x0 00010000:00010000:2.0:1789265716.247741:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=571s v=(0 0) 00010000:00010000:2.0:1789265716.247747:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265716.247759:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec0690ee/0xbbfdc9019c1d52fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196b5 expref: 7 pid: 18652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.247785:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec0690ee/0xbbfdc9019c1d52fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196b5 expref: 7 pid: 18652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.247802:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fc000, rc 0) 00000100:00100000:2.0:1789265716.247902:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:296b6286-1162-4204-a595-38172c479be3+7:2400:x1876180556980736:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 308us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265716.247911:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:1.0:1789265716.251696:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265716.251797:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556980992 00000100:00100000:3.0:1789265716.251811:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556980992 00000100:00100000:3.0:1789265716.251931:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:3.0:1789265716.251945:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9377507a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+36:15659:x1876180556980992:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789265716.252359:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9377507a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:296b6286-1162-4204-a595-38172c479be3+36:15659:x1876180556980992:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 416us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265716.252367:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:1.0:1789265716.257190:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265716.257364:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556981120 00000100:00100000:0.0:1789265716.257379:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556981120 00000100:00100000:0.0:1789265716.257498:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:0.0:1789265716.257513:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+36:15659:x1876180556981120:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789265716.259666:0:17124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1789265716.259684:0:17124:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789265716.259748:0:17124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1789265716.259749:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5137 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.259764:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5137 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.259772:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5137 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.259795:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181ba00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265716.259801:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5137 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.259810:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5137 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.259831:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93774e579400) 00010000:00010000:1.0:1789265716.259835:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265716.259839:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5137 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.259846:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ba00/0xbbfdc9019c1d5137 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265716.260469:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579085824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789265716.260676:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265716.260815:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579085824 00000100:00100000:3.0:1789265716.260828:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579085824 00010000:00010000:0.0:1789265716.260849:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b400/0xbbfdc9019c1d518b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265716.260934:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265716.260946:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93775dc25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579085824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789265716.261169:0:18650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789265716.261172:0:18650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00010000:00010000:0.0:1789265716.261174:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b400/0xbbfdc9019c1d518b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789265716.261175:0:18650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789265716.261177:0:18650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789265717 -> 1789265717 00002000:00010000:3.0:1789265716.261180:0:18650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1789265716.261182:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b400/0xbbfdc9019c1d518b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265716.261273:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93775dc25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876180579085824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 329us (597us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789265716.261282:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1789265716.261309:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d513e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261318:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d513e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261324:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d513e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261330:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181a400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265716.261334:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d513e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261342:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d513e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261375:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93774e579c00) 00010000:00010000:1.0:1789265716.261378:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265716.261382:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d513e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261389:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a400/0xbbfdc9019c1d513e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261421:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d51e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261427:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d51e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261432:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d51e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261437:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181bc00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265716.261440:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d51e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261447:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d51e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261454:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93774e579000) 00010000:00010000:1.0:1789265716.261456:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265716.261459:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d51e6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261465:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181bc00/0xbbfdc9019c1d51e6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261492:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d526b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261499:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d526b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261505:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d526b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261511:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181ae00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265716.261514:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d526b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261520:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d526b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261528:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:1.0:1789265716.261531:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265716.261533:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d526b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261538:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181ae00/0xbbfdc9019c1d526b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261550:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261555:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261562:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261572:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fd000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265716.261576:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261583:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261594:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff937742a28c00) 00010000:00010000:1.0:1789265716.261596:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789265716.261599:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52e2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.261606:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9377413fd000/0xbbfdc9019c1d52e2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.261715:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181b400 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:0.0:1789265716.261720:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b400/0xbbfdc9019c1d518b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.261727:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b400/0xbbfdc9019c1d518b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.261750:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93774e579c00) 00010000:00010000:0.0:1789265716.261752:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789265716.261756:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b400/0xbbfdc9019c1d518b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.261761:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181b400/0xbbfdc9019c1d518b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265716.262435:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:296b6286-1162-4204-a595-38172c479be3+15:15659:x1876180556981120:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 Request processed in 4917us (5250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265716.262447:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 61 00000004:00080000:2.0:1789265716.266756:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93777f464700/2, rc 0, transno 8589934596 00000100:00100000:2.0:1789265716.266777:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579085824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789265716.277811:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.278355:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556981248 00000100:00100000:2.0:1789265716.278370:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556981248 00000100:00100000:2.0:1789265716.278461:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:2.0:1789265716.278475:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:296b6286-1162-4204-a595-38172c479be3+7:2400:x1876180556981248:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789265716.278663:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:296b6286-1162-4204-a595-38172c479be3+7:2400:x1876180556981248:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 Request processed in 191us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265716.278671:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:0.0:1789265716.293511:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265716.294380:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556981504 00000100:00100000:1.0:1789265716.294397:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556981504 00000100:00100000:1.0:1789265716.295440:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:1.0:1789265716.295462:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+15:15659:x1876180556981504:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789265716.295556:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265716.295606:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d52f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196ae expref: 15 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.295634:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff937742a28c00) 00010000:00010000:1.0:1789265716.295661:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265716.295708:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d5305 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.295725:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d5305 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.295738:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d5305 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265716.295990:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010b23154 reply state 00000000655b4ff1 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d5305 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.296006:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030c00/0xbbfdc9019c1d5305 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.296013:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff937742a28c00) 00010000:00010000:1.0:1789265716.296016:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265716.296019:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265716.296177:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+16:15659:x1876180556981504:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 725us (2693us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789265716.296186:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:1.0:1789265716.302990:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.303092:0:19187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556981632 00000100:00100000:2.0:1789265716.303105:0:19187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556981632 00000100:00100000:2.0:1789265716.303173:0:19187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:2.0:1789265716.303184:0:19187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:296b6286-1162-4204-a595-38172c479be3+7:15659:x1876180556981632:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265716.303214:0:19187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265716.303243:0:19187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d530c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9196bc expref: -99 pid: 19187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.303285:0:19187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec0690ee/0xbbfdc9019c1d52fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196b5 expref: 8 pid: 18652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.303295:0:19187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265716.303300:0:19187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265716.303306:0:19187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d530c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196bc expref: 8 pid: 19187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.303348:0:19187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec0690ee/0xbbfdc9019c1d52fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196b5 expref: 8 pid: 18652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.303363:0:19187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec0690ee/0xbbfdc9019c1d52fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196b5 expref: 8 pid: 18652 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265716.303417:0:19187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93775dc27480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19187:1876180579085952:192.168.202.42@tcp:104: 00000100:00100000:2.0:1789265716.303516:0:19187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9376422f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265716.306956:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265716.307387:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556981760 00000100:00100000:3.0:1789265716.307400:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556981760 00010000:00010000:3.0:1789265716.307471:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec0690ee/0xbbfdc9019c1d52fe lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196b5 expref: 9 pid: 18652 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265716.307527:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:3.0:1789265716.307540:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:296b6286-1162-4204-a595-38172c479be3+9:2399:x1876180556981760:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265716.307560:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265716.307590:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec0690ee/0xbbfdc9019c1d52fe lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196b5 expref: 9 pid: 18652 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.307630:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec0690ee/0xbbfdc9019c1d52fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196b5 expref: 9 pid: 18652 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.307664:0:17130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265716.307669:0:17130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265716.307676:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d530c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196bc expref: 9 pid: 19187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.307688:0:17130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d530c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196bc expref: 9 pid: 19187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.307734:0:17130:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d530c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196bc expref: 9 pid: 19187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265716.307751:0:17130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f466680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17130:1876180579086080:192.168.202.42@tcp:105: 00000100:00100000:3.0:1789265716.307902:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0480 going to sleep for 11 seconds 00010000:00010000:2.0:1789265716.309014:0:19187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec0690ee/0xbbfdc9019c1d52fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196b5 expref: 9 pid: 18652 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265716.309042:0:19187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93775dc27480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19187:1876180579085952:192.168.202.42@tcp:104: 00010000:00010000:2.0:1789265716.309085:0:19187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d530c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196bc expref: 8 pid: 19187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.309100:0:19187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9377413fdc00, rc 0) 00000100:00100000:2.0:1789265716.309174:0:19187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:296b6286-1162-4204-a595-38172c479be3+8:15659:x1876180556981632:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 5990us (6198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265716.309182:0:19187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:0.0:1789265716.320960:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.321714:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556981888 00000100:00100000:2.0:1789265716.321729:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556981888 00000100:00100000:2.0:1789265716.321814:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:2.0:1789265716.321827:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93774e40df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:296b6286-1162-4204-a595-38172c479be3+8:2400:x1876180556981888:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789265716.322073:0:18652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789265716.322077:0:18652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789265717 00002000:00010000:2.0:1789265716.322079:0:18652:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789265716 00002000:00010000:2.0:1789265716.322081:0:18652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789265717 -> 1789265717 00002000:00010000:2.0:1789265716.322083:0:18652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789265716.322160:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:296b6286-1162-4204-a595-38172c479be3+9:2400:x1876180556981888:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 335us (1216us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789265716.322185:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:3.0:1789265716.322525:0:17130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f466680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17130:1876180579086080:192.168.202.42@tcp:105: 00010000:00010000:3.0:1789265716.322553:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265716.322592:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93774e40c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:296b6286-1162-4204-a595-38172c479be3+8:2399:x1876180556981760:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 15054us (15654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265716.322603:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:1.0:1789265716.325707:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265716.325902:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556982016 00000100:00100000:3.0:1789265716.325916:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556982016 00000100:00100000:3.0:1789265716.325978:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:3.0:1789265716.326003:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:296b6286-1162-4204-a595-38172c479be3+8:2397:x1876180556982016:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789265716.326066:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000edecada4/0xbbfdc9019c1d5313 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.326093:0:18650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d530c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196bc expref: 8 pid: 19187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.326102:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265716.326108:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265716.326113:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edecada4/0xbbfdc9019c1d5313 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.326157:0:18650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d530c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196bc expref: 8 pid: 19187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.326173:0:18650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d530c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196bc expref: 8 pid: 19187 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265716.326189:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f466680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18650:1876180579086208:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265716.326531:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265716.329950:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f466680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18650:1876180579086208:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265716.329995:0:18650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000edecada4/0xbbfdc9019c1d5313 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265716.333090:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1789265716.339850:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556982144 00000100:00100000:2.0:1789265716.339884:0:17898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556982144 00010000:00010000:2.0:1789265716.339953:0:17898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d530c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196bc expref: 9 pid: 19187 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265716.340093:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:2.0:1789265716.340105:0:17898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643519500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:296b6286-1162-4204-a595-38172c479be3+9:2399:x1876180556982144:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265716.340124:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265716.340152:0:17898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d530c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196bc expref: 9 pid: 19187 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.340169:0:17898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d530c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196bc expref: 9 pid: 19187 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.340210:0:17898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d530c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196bc expref: 9 pid: 19187 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.340241:0:17898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1789265716.340247:0:17898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 1) 00010000:00010000:2.0:1789265716.340253:0:17898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000edecada4/0xbbfdc9019c1d5313 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.340265:0:17898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edecada4/0xbbfdc9019c1d5313 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.340321:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265716.340399:0:17898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643519500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:296b6286-1162-4204-a595-38172c479be3+8:2399:x1876180556982144:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 297us (7326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265716.340423:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00010000:00010000:1.0:1789265716.341297:0:18650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000edecada4/0xbbfdc9019c1d5313 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.341313:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edecada4/0xbbfdc9019c1d5313 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.341366:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000edecada4/0xbbfdc9019c1d5313 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.341375:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edecada4/0xbbfdc9019c1d5313 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.341384:0:18650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edecada4/0xbbfdc9019c1d5313 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.341392:0:18650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181a200 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:1.0:1789265716.341397:0:18650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edecada4/0xbbfdc9019c1d5313 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.341423:0:18650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edecada4/0xbbfdc9019c1d5313 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.341441:0:18650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edecada4/0xbbfdc9019c1d5313 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.341450:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edecada4/0xbbfdc9019c1d5313 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265716.341553:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:296b6286-1162-4204-a595-38172c479be3+7:2397:x1876180556982016:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 Request processed in 15549us (15857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265716.341575:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:1.0:1789265716.349915:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265716.350545:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556982400 00000100:00100000:3.0:1789265716.350581:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556982400 00000100:00100000:3.0:1789265716.350662:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:3.0:1789265716.350674:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+16:15659:x1876180556982400:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789265716.350792:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.350814:0:17143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d5264 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91967d expref: 16 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.350823:0:17143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.350906:0:17143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d5264 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91967d expref: 16 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.350923:0:17143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d5264 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91967d expref: 16 pid: 17143 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265716.350942:0:17143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f466680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1876180579086336:192.168.202.42@tcp:104: 00000100:00100000:3.0:1789265716.351060:0:17143:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265716.355257:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265716.355427:0:17143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f466680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1876180579086336:192.168.202.42@tcp:104: 00010000:00010000:3.0:1789265716.355466:0:17143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265716.357760:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556982528 00000100:00100000:1.0:1789265716.357778:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556982528 00010000:00010000:0.0:1789265716.362352:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d5264 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91967d expref: 17 pid: 17143 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265716.362606:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:3.0:1789265716.362628:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643d13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:296b6286-1162-4204-a595-38172c479be3+17:2400:x1876180556982528:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265716.362651:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265716.362677:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d5264 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91967d expref: 17 pid: 17143 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.362693:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d5264 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91967d expref: 17 pid: 17143 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.362726:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d5264 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91967d expref: 17 pid: 17143 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.362749:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:3.0:1789265716.362756:0:17130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff937740031200/0xbbfdc9019c1d5280 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91968b expref: 16 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.362769:0:17130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.362777:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.362785:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.362933:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265716.363012:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643d13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:296b6286-1162-4204-a595-38172c479be3+16:2400:x1876180556982528:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 394us (7771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265716.363022:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00010000:00010000:1.0:1789265716.367355:0:17143:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.367379:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.367842:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.367985:0:17143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d52e9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196a7 expref: 16 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.367997:0:17143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.368051:0:17143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d52e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196a7 expref: 16 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.368070:0:17143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d52e9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196a7 expref: 16 pid: 19934 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265716.368089:0:17143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764351ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1876180579086464:192.168.202.42@tcp:104: 00000100:00100000:1.0:1789265716.368424:0:17143:0:(client.c:2715:ptlrpc_set_wait()) set ffff937743426180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265716.372703:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265716.372841:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556982656 00000100:00100000:3.0:1789265716.372852:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556982656 00000100:00100000:1.0:1789265716.373083:0:17143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764351ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1876180579086464:192.168.202.42@tcp:104: 00010000:00010000:1.0:1789265716.373142:0:17143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.373364:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d52e9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196a7 expref: 17 pid: 19934 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265716.373517:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:2.0:1789265716.373530:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f583100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:296b6286-1162-4204-a595-38172c479be3+17:2399:x1876180556982656:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265716.373550:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265716.373558:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d52e9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196a7 expref: 17 pid: 19934 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.373683:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d52e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196a7 expref: 17 pid: 19934 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.373715:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937642392a00/0xbbfdc9019c1d52e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196a7 expref: 17 pid: 19934 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.373735:0:17131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff937742a28c00) 00010000:00010000:2.0:1789265716.373741:0:17131:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.373752:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.373774:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.373810:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265716.373924:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f583100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:296b6286-1162-4204-a595-38172c479be3+16:2399:x1876180556982656:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 396us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265716.373933:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00010000:00010000:3.0:1789265716.373997:0:17143:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.374016:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265716.374164:0:17143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1789265716.374329:0:17143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1789265716.374368:0:17143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1789265716.374829:0:17143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93777f466680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17143:1876180579086592:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789265716.374940:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265716.374979:0:17143:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789265716.376212:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579086592 00000100:00100000:0.0:1789265716.376236:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579086592 00000100:00100000:0.0:1789265716.376311:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789265716.376322:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17143:x1876180579086592:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789265716.376478:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17143:x1876180579086592:12345-0@lo:1000:mdt00_000.0 Request processed in 157us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265716.376486:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789265716.376834:0:17143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93777f466680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17143:1876180579086592:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789265716.377113:0:17143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789265716.377215:0:17143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642750700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17143:1876180579086720:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789265716.377272:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265716.377293:0:17143:0:(client.c:2715:ptlrpc_set_wait()) set ffff93774f3c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265716.377804:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579086720 00000100:00100000:0.0:1789265716.377812:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579086720 00000100:00100000:0.0:1789265716.377897:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789265716.377907:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17143:x1876180579086720:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789265716.378099:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17143:x1876180579086720:12345-0@lo:1000:mdt00_000.0 Request processed in 194us (826us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789265716.378108:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789265716.378215:0:17143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642750700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17143:1876180579086720:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789265716.378278:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378290:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378299:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378306:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030e00 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265716.378311:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378321:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378343:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff937742a28c00) 00010000:00010000:1.0:1789265716.378346:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265716.378351:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378358:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5321 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378397:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d5279 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378590:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d5279 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378607:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d5279 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378613:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031000 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265716.378616:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d5279 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378623:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d5279 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378632:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:1.0:1789265716.378635:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265716.378643:0:17143:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff937740031200/0xbbfdc9019c1d5280 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91968b expref: 19 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378657:0:17143:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031200/0xbbfdc9019c1d5280 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91968b expref: 19 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378667:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031200/0xbbfdc9019c1d5280 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91968b expref: 19 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.378734:0:17143:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff937740031200/0xbbfdc9019c1d5280 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d91968b expref: 19 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265716.378748:0:17143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93764351ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1876180579086848:192.168.202.42@tcp:105: 00000100:00100000:1.0:1789265716.378835:0:17143:0:(client.c:2715:ptlrpc_set_wait()) set ffff937743426540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265716.382339:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265716.382467:0:17143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93764351ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17143:1876180579086848:192.168.202.42@tcp:105: 00010000:00010000:1.0:1789265716.382528:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d5279 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382540:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031000/0xbbfdc9019c1d5279 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382584:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d5328 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382603:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d5328 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382616:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d5328 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382629:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d5328 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382636:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d5328 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382643:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d5328 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382650:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740031800 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265716.382654:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d5328 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382663:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d5328 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382677:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:1.0:1789265716.382686:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265716.382691:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d5328 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382697:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740031800/0xbbfdc9019c1d5328 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382707:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382712:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382718:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382722:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181a600 already unused, calling callback (ffffffffc19db4f0) 00010000:00010000:1.0:1789265716.382724:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382729:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382737:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:1.0:1789265716.382740:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265716.382742:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.382749:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93775181a600/0xbbfdc9019c1d531a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265716.382979:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+19:15659:x1876180556982400:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 32305us (33077us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789265716.383002:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 63 00000020:00080000:1.0:1789265716.383011:0:17143:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789265716.383592:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789265716.383599:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789265716.383638:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789265716.383646:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789265716.387015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265716.387153:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556982784 00000100:00100000:1.0:1789265716.387168:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556982784 00000100:00100000:1.0:1789265716.387520:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556983040 00000100:00100000:1.0:1789265716.387525:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556983040 00000100:00100000:1.0:1789265716.387557:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:1.0:1789265716.387569:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937781008850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:296b6286-1162-4204-a595-38172c479be3+20:15658:x1876180556982784:12345-192.168.202.42@tcp:49:dd.0 00000100:00100000:1.0:1789265716.387748:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937781008850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:296b6286-1162-4204-a595-38172c479be3+20:15658:x1876180556982784:12345-192.168.202.42@tcp:49:dd.0 Request processed in 180us (5425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265716.387757:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:1.0:1789265716.387811:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:1.0:1789265716.387818:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:296b6286-1162-4204-a595-38172c479be3+19:15659:x1876180556983040:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789265716.388159:0:17146:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789265716.390782:0:17146:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1789265716.390909:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d532f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.390934:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d532f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.390949:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d532f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.390960:0:17146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d532f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.390968:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d532f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.390995:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d532f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.391018:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789265716.391150:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:296b6286-1162-4204-a595-38172c479be3+21:15659:x1876180556983040:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 3326us (4144us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789265716.391161:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00000020:00080000:1.0:1789265716.391168:0:17146:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789265716.392341:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265716.392356:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d532f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.392365:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937740030000 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:2.0:1789265716.392370:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d532f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.392381:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d532f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.392417:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff937742a28c00) 00010000:00010000:2.0:1789265716.392421:0:17132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789265716.392426:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d532f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.392433:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030000/0xbbfdc9019c1d532f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.392452:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265716.392454:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265716.392456:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265716.393722:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265716.395768:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556983168 00000100:00100000:1.0:1789265716.395791:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556983168 00000100:00100000:1.0:1789265716.395908:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:1.0:1789265716.395921:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+21:15658:x1876180556983168:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:1.0:1789265716.395950:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265716.395977:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5336 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ee42ae03d9196c3 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.396022:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d533d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.396040:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d533d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.396054:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d533d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.396224:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937740030e00/0xbbfdc9019c1d5336 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196c3 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.396584:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937740030800/0xbbfdc9019c1d533d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0x1ee42ae03d9196c3 expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265716.396594:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93774e579b00) 00010000:00010000:1.0:1789265716.396597:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265716.396601:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937740030800, rc 0) 00000100:00100000:1.0:1789265716.396688:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:296b6286-1162-4204-a595-38172c479be3+22:15658:x1876180556983168:12345-192.168.202.42@tcp:101:dd.0 Request processed in 770us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265716.396694:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:3.0:1789265716.517135:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1789265716.517255:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1789265716.530209:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556983296 00000100:00100000:0.0:1789265716.530276:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556983296 00000100:00100000:0.0:1789265716.530536:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556983424 00000100:00100000:0.0:1789265716.530541:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556983424 00000100:00100000:2.0:1789265716.530636:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:2.0:1789265716.530667:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:296b6286-1162-4204-a595-38172c479be3+8:2399:x1876180556983296:12345-192.168.202.42@tcp:4:dd.0 00002000:00010000:2.0:1789265716.530730:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa60735, atime: 0x6aa60734, ctime: 0x6aa60735, blocks: 0x0 00010000:00010000:2.0:1789265716.530742:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d5344 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.530763:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789265716.530768:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265716.530776:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d5344 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265716.530792:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d5344 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265716.642653:0:19464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1789265716.642681:0:19464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:3.0:1789265716.643100:0:18657:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1789265716.643108:0:18657:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:3.0:1789265716.643129:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d5344 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.643145:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d5344 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.643154:0:18657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d5344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.643179:0:18657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9377413fdc00 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:3.0:1789265716.643184:0:18657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d5344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.643270:0:18657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d5344 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.643298:0:18657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d5344 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.643306:0:18657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018d9e4be/0xbbfdc9019c1d5344 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265716.643517:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:296b6286-1162-4204-a595-38172c479be3+6:2399:x1876180556983296:12345-192.168.202.42@tcp:4:dd.0 Request processed in 112847us (126390us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789265716.643538:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:3.0:1789265716.645319:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:3.0:1789265716.645348:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:296b6286-1162-4204-a595-38172c479be3+5:2399:x1876180556983424:12345-192.168.202.42@tcp:4:dd.0 00002000:00010000:3.0:1789265716.645481:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6aa60735, atime: 0x6aa60734, ctime: 0x6aa60735, blocks: 0x2000 00010000:00010000:3.0:1789265716.645493:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d534b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.645513:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789265716.645518:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265716.645526:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d534b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265716.645562:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d534b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265716.714002:0:19464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1789265716.714483:0:18657:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1789265716.714490:0:18657:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1789265716.714509:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d534b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.714521:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d534b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.714529:0:18657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d534b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.714536:0:18657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93775181b400 already unused, calling callback (ffffffffc0da9350) 00010000:00010000:0.0:1789265716.714541:0:18657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d534b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.714550:0:18657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d534b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.714586:0:18657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d534b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265716.714593:0:18657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005077eef3/0xbbfdc9019c1d534b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265716.714766:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:296b6286-1162-4204-a595-38172c479be3+5:2399:x1876180556983424:12345-192.168.202.42@tcp:4:dd.0 Request processed in 69425us (197502us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789265716.714779:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 1 00010000:00010000:0.0:1789265716.915206:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265717.944815:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265718.528560:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265718.528604:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265718.528634:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265718.528649:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265718.528667:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265718.528682:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265718.528700:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265718.528717:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265718.528740:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1789265718.528767:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556983808 00000100:00100000:1.0:1789265718.528778:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556983808 00000100:00100000:1.0:1789265718.528832:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556984320 00000100:00100000:1.0:1789265718.528836:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556984320 00000100:00100000:1.0:1789265718.528852:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556983680 00000100:00100000:1.0:1789265718.528854:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556983680 00000100:00100000:1.0:1789265718.528894:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556984192 00000100:00100000:1.0:1789265718.528897:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556984192 00000100:00100000:1.0:1789265718.528927:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:1.0:1789265718.528937:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+5:2397:x1876180556983808:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265718.529017:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+5:2397:x1876180556983808:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 81us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265718.529024:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:1.0:1789265718.529500:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:1.0:1789265718.529508:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2397:x1876180556984320:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265718.529539:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2397:x1876180556984320:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 32us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265718.529546:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:1.0:1789265718.529558:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:3.0:1789265718.529660:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:3.0:1789265718.529672:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+6:2397:x1876180556984192:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1789265718.529716:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3745b3d0-dd9e-43a3-937e-965b55464c77+6:2397:x1876180556984192:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 38us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265718.529723:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:1.0:1789265718.530015:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+22:2397:x1876180556983680:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265718.530165:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556983552 00000100:00100000:2.0:1789265718.530172:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556983552 00000100:00100000:2.0:1789265718.530220:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 170 00000100:00100000:2.0:1789265718.530228:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9376437c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:2397:x1876180556983552:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265718.530333:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9376437c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba7beb9c-943e-4381-81e6-43a0a05c3424+13:2397:x1876180556983552:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 105us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265718.530341:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 170 00000100:00100000:2.0:1789265718.530378:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556984064 00000100:00100000:2.0:1789265718.530383:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556984064 00000100:00100000:2.0:1789265718.530414:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556984576 00000100:00100000:2.0:1789265718.530417:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556984576 00000100:00100000:2.0:1789265718.530440:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556983936 00000100:00100000:2.0:1789265718.530442:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556983936 00000100:00100000:2.0:1789265718.530455:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180556984448 00000100:00100000:2.0:1789265718.530457:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180556984448 00000100:00100000:2.0:1789265718.530471:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:2.0:1789265718.530478:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:296b6286-1162-4204-a595-38172c479be3+5:2397:x1876180556984064:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265718.530506:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:296b6286-1162-4204-a595-38172c479be3+5:2397:x1876180556984064:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265718.530512:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:2.0:1789265718.530524:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:2.0:1789265718.530530:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2397:x1876180556984576:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1789265718.530552:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2397:x1876180556984576:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265718.530558:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:1.0:1789265718.530659:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:296b6286-1162-4204-a595-38172c479be3+22:2397:x1876180556983680:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 1093us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265718.530666:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:1.0:1789265718.530692:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:1.0:1789265718.530699:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:296b6286-1162-4204-a595-38172c479be3+5:2397:x1876180556983936:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265718.530722:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:296b6286-1162-4204-a595-38172c479be3+5:2397:x1876180556983936:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265718.530728:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:1.0:1789265718.530740:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:1.0:1789265718.530747:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93764351aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2397:x1876180556984448:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1789265718.530767:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93764351aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3745b3d0-dd9e-43a3-937e-965b55464c77+5:2397:x1876180556984448:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 21us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265718.530780:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00080000:0.0:1789265718.530921:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265718.530926:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265718.530929:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265718.530931:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1789265718.735645:0:20320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1789265718.964127:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265719.795604:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579086976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265719.795679:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265719.795843:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579086976 00000100:00100000:2.0:1789265719.795852:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579086976 00000100:00100000:2.0:1789265719.795947:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265719.795956:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93777f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579086976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789265719.795986:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1789265719.796056:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265719.803534:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93777f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180579086976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7566us (7841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265719.803551:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265719.804414:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876180579086976:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789265719.988104:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265720.819039:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265720.819061:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937643519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579087104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265720.819087:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265720.819100:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579087232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265720.819135:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265720.819143:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265720.819221:0:19984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579087104 00000100:00100000:1.0:1789265720.819228:0:19984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579087104 00000100:00100000:1.0:1789265720.819296:0:19984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265720.819304:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579087232 00000100:00100000:3.0:1789265720.819310:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579087232 00000100:00100000:1.0:1789265720.819310:0:19984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579087104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265720.819334:0:19984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789265720.819345:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265720.819354:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937642751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579087232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265720.819390:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265720.819429:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937642751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876180579087232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265720.819437:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265720.819479:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876180579087232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265720.820093:0:19984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180579087104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 786us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265720.820101:0:19984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789265720.820134:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265720.820656:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937643519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876180579087104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265720.820725:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265720.820737:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579087360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265720.820782:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265720.820890:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180579087360 00000100:00100000:3.0:1789265720.820897:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180579087360 00000100:00100000:3.0:1789265720.820943:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789265720.820974:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937643519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579087360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265720.821001:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789265720.821058:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937643519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876180579087360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265720.821065:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789265720.821264:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff937642751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876180579087360:0@lo:41:osp-pre-0-1.0 Debug log: 43553 lines, 43553 kept, 0 dropped, 0 bad.